KOTTWITZ-RAPOPORT AND p-RANK STRATA IN THE 
REDUCTION OF SHIMURA VARIETIES OF PEL TYPE 
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Abstract. We study the reduction of certain integral models of Shimura 
varieties of PEL type with Iwahori level structure. On these spaces we 
have the Kottwitz-Rapoport and the p-rank stratification. We show that 
the p-rank is constant on a KR stratum, generalizing a result of Ngo and 
Genestier. We prove an abstract, uniform formula for the p-rank on a 
KR stratum. In the symplectic and in the unitary case we derive explicit 
formulas for its value. We apply these formulas to the question of the 
density of the ordinary locus and to the question of the dimension of the 
p-rank locus. 



1. Introduction 
Fix a rational prime p 7^ 2 and a PEL datum B = (B, *, V, (-, •) , J) with 



auxiliary data B p = (Ob,£), see Section 2.1 The datum B gives rise to 
a reductive group G over Q and a conjugacy class h of homomorphisms 
R- es c/M — > Gr. Fix a compact open subgroup C p C G(A P ,). From C p and 
Bp one obtains a compact open subgroup C C G(Af) and thus a Shimura 
datum (G, h, C). In [244 Section 6], Rapoport and Zink construct from B, B p 
and C p an integral model A = Aqp of the Shimura variety associated with 
(G, h, C). Concretely A is defined as a moduli space of abelian schemes with 
additional structure. 

In order to study properties of the scheme A, Rapoport and Zink introduce 
the so-called local model M loc . It is defined purely in terms of linear algebra 
and therefore easier to investigate than A. The schemes A and M loc are 
related via an intermediate object A fitting into the so called local model 
diagram 




Etale locally on A, there is a section s : A — > A of ip such that the composition 

A A A —¥ M loc is etale. Consequently A inherits any property from 
M loc which is local for the etale topology. In particular, questions about 
singularities of A or the flatness of A can equivalently be studied for M loc . 
Let us mention that recently a purely group-theoretic definition of the local 
model was given in |23j by Pappas and Zhu, providing an intriguing new 
perspective on the local model diagram. 

The PEL datum also gives rise to an affine smooth group scheme Aut(£), 
and Aut(£) acts on both A and M loc . The map tp is an Aut(£)-torsor, while 
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the map if) is Aut(£)-equivariant. Denote by F an algebraic closure of ¥ p . Via 
the local model diagram, the decomposition of M loc (F) into Aut(£)(F)-orbits 
induces the Kottwitz-Rapoport (or KR) stratification 

A(¥) = ]J A x , 

xeAut(£)(F)\M loc (F) 

which was first introduced by Ngo and Genestier in [16J. The Aut(£)(F)- 
orbits on M loc (F) admit the following interesting description. In all cases 
considered thus far (cf. the discussion in [22l §3.3]), the special fiber Mp oc 
of M loc embeds into an affine flag variety J 7 , which is defined as a moduli 
space of lattice chains over the ring of formal power series F[u]. In analogy 
with the Bruhat decomposition of the classical flag variety, indexed by the 
finite Weyl group W, the affine flag variety admits the Iwahori decomposition 
J 7 (¥) = IIzgH? C x into Schubert cells C x , indexed by the extended affine Weyl 

group W. It then turns out that A4° c C T is a disjoint union of Schubert 
cells and that the decomposition M loc (F) = Uc a .cA/ loc (F) ^ coincides with 
the decomposition of M Ioc (F) into Aut(£)(F)-orbits. As in the case of the 
Bruhat decomposition, many properties of the Iwahori decomposition are 
easily expressed by combinatorial properties of the corresponding index 
element in W. Notably, the dimension of C x is given by the length £(x) of x 
in W, and the closure relation between Schubert cells is expressed by the 
Bruhat order on W. We conclude that the same statements hold for the KR 
stratification on „4(F). 

Let us explain in detail one case in which this convenient combinatorial 
behavior of the KR stratification was fruitfully exploited. For B = Q and 
a complete lattice chain C, the moduli problem A specializes to the Siegel 
moduli space Ai of principally polarized abelian varieties with Iwahori level 
structure. In [6], Gortz and Yu compute the dimension of the p-rank locus 
in Ai, and this computation was later generalized in [9] by Hamacher to the 
case of all p-rank strata. The method is the same in both cases: Determine 
all KR strata contained in a given p-rank stratum and compute the maximum 
of their dimensions. For this method to work one of course needs to know 
that a p-rank stratum is indeed the union of the KR strata contained in 
it. Thus both papers depend crucially on the result [TBI Theoreme 4.1] of 
Ngo and Genestier, which states that indeed the p-rank is constant on a 
KR stratum in Ai, and also provides an explicit formula for the p-rank on a 
given KR stratum. 

The subject of this paper is to generalize the result of Ngo and Genestier 
on the relationship between the KR and the p-rank stratification to more 
general PEL data. Let us give an outline of the structure of this paper and 
of the results that we have obtained. 



In Sections 2.1 through 2.3, we recall the construction of the local model 
diagram. We then show the following result. 

Theorem 1.0.1. Let B be an arbitrary PEL datum. Lf C is complete (in 



the sense of Definition 2.4-2), the p-rank is constant on a KR stratum. 

Before being able to state our next result, we need some more notation. 
Denote by O k = W{¥) the Witt ring of F, by K the fraction field of O k 
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and by a the Frobenius on K. Denote by D the diagonalizable affine group 
with character group Q over K. For b G G(K) denote by i/& : D — > Gk the 
corresponding Newton map. By definition, the group Gk acts on Vk and 
thus ffe gives rise to a representation of D on Vk- Consider the corresponding 
weight decomposition Vk = ©xeQ^x an d define 

v bfi := dim^ V . 

Denote by / the stabilizer of £ ® in For 6 G G(if) and x G 

I\G(K)/I we denote by X^fe) = { 5 G G(iT)/I | g- 1 ba{g) G /xl} the affine 
Deligne-Lusztig variety associated with b and x. 

By interpreting the KR stratification in terms of the relative position 
of C (8> Ojf to its image under Frobenius, we show that the KR strata are 
precisely the fibers of a canonical map 7 : .4(F) — > I\G(K)/I. Denote by 
Perm C I\G(K)/I the image of 7, and for x G Perm by A x = 7 _1 (x) the 
corresponding KR stratum. 

Theorem 1.0.2. Let x G Perm and let b G G{K). Assume that X x (b) / 0. 
Then the p-rank on A x is constant with value z/^q- 

In Sections [3] through [7] we turn to the aforementioned interpretation of 
the KR stratification in terms of the affine flag variety. Section [3] deals with 
the case of the symplectic group. Section [5] (resp. |6| resp. [7]) deals with the 
case of a unitary group associated with a ramified (resp. inert, resp. split) 
quadratic extension. Let us note that the embedding of M^ c into an affine 
flag variety has a long history. In particular we want to emphasize that we 
have greatly profited from the expositions by Pappas and Rapoport in |19j . 
[20] , [21] , and by Smithling in [26] , [27] . We have decided to repeat part of 
their discussions, on the one hand for the convenience of the reader, and on 
the other to provide several proofs and details that have been omitted in loc. 
cit. 

Our discussion is quite similar in all cases. We begin with describing in 
detail the PEL datum at hand, including the Hodge structure and the result- 
ing determinant morphism. We proceed by making explicit the definition 
of the local model and investigate its base-change to F. We then recall the 
definition of the affine flag variety in terms of lattice chains and prove in 
detail that it can also be described as a suitable quotient of loop groups. We 
conclude the discussion of the local model by embedding it into the affine 
flag variety and prove that the Aut(£)-orbits on M loc (F) are precisely the 
Schubert cells contained in M loc (F). We then prove an explicit formula for 
the p-rank on a KR stratum. 

Using these explicit formulas and the aforementioned combinatorial struc- 
ture of the KR stratification, we prove the following geometric results. 

1.1. Density of the ordinary locus. It is an interesting question whether 
the ordinary locus lies dense in A^. In the case of hyperspecial level structure, 
it has been studied in detail by Wedhorn in [31] . 

We focus on the case of Iwahori level structure. In the corresponding 
Siegel case Ai, the result [161 Corollaire 4.3] of Ngo and Genestier answers 
this question affirmatively. On the other hand, Stamm obtains in [29] 
a negative answer in the two-dimensional Hilbert-Blumenthal case. The 
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following result generalizes these two results and explains the general pattern, 
thereby answering a question by M. Rapoport. 



Theorem 1.1.1 (Corollary [3.11 .3[ ). A ssume that B is the symplectic PEL 



datum associated with a totally real extension F/Q (see Section 3.2 for a 
detailed description ofB). Assume (without loss of generality) that there is 
only a single prime of Of dividing p. Then the ordinary locus lies dense in 
Aw if and only if p is totally ramified in Of- 

1.2. Dimension of the p-rank locus. As mentioned above, Gortz and 
Yu use |16t Theoreme 4.1] to compute the dimension of the p-rank locus in 
Ai, see (HI Theorem 8.8]. By copying their approach and using our formula 
for the p-rank on a KR stratum in the split unitary case, we obtain the 
following result. 



Theorem 1.2.1 (Theorem 7.5.9). Assume that B is the unitary PEL datum 



of signature (r, n — r) associated with an imaginary quadratic extension q 



in which p splits (see Section 7.1 for a detailed description ofB). Denote by 
A^ C .4(F) the subset where the p-rank of the underlying abelian variety is 
equal to 0. Then 

dim_4(°) = min((r — l)(n — r), r(n — r — 1)) . 

1.3. The Hilbert-Blumenthal case. As an illustrative example, we look 
in Section 13.121 at the case of the Hilbert-Blumenthal modular varieties. 
Without any additional work, we obtain the following result. 



Theorem 1.3.1 (Theorem [3.12. 3[ ). Let g > 2 and let A be the Hilbert- 
Blumenthal modular variety with Tq(p) -level structure associated with a 
totally real extension of degree g o/Q. Denote by A^ C Ay and A^- 9 ' C Aw 
the subsets where the p-rank of the underlying abelian variety is equal to 
and g, respectively. Then 

A ¥ = A (0) U A (9) . 

The ordinary locus A^ is the union of only two KR strata A Xl and A X2 ■ 
Consequently we have 

Aw = A Xl u A X2 u A^. 

Here A x denotes the closure of the KR stratum A x in Aw. 

Each ofAw,A Xl ,A X2 and A^ is equidimensional of dimension 2 9 . 
Furthermore, we have 

A Xl n A X2 cz A^ ^ . 

Taking g = 2, we recover the result [29, Theorem 2 (p. 408)] of Stamm. 
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Notation. We fix once and for all a rational prime p ^ 2 and an algebraic 
closure F of F p . 
Let n G N>i. 

• For elements x\, . . . , x n of some set and fci, . . . k n G N, we denote by 
(x[ kl \...,x { n n) ) the tuple 

(xi, . . . , X\j , . . . , Xn, . . . , Xn). 
fci-times fe n -times 

For a tuple x G Z n , we denote by x(i) its i-th entry. 

• For an element w of S n , the symmetric group on n letters, we denote 
by A w = (Si w tj\)ij the corresponding permutation matrix. 

• We write 

J211 = ( °~ ^ ) j where I n = anti-diag(l, . . . , 1). 



-In 

Let R be a ring and let R — > R' be an i?-algebra. 

• We denote the dual of various objects over R by a superscript - v = 

y,R 

• We often denote the base-change from R to R' by a subscript 

• If G is a functor on the category of ii'-algebras, we denote by 
R- es i?' Ir G the functor on the category of ii-algebras with (Res^/ m G)(S) 
G{S® R R'). 

• If F is a functor on the category of algebras (resp. 
algebras), we denote by LF = h u F (resp. L + F = L^ F) the func- 
tor on the category of ii-algebras with LF(S) = F(S((u))) (resp. 
L+F(S) = F(S{ul)). 

• For A e Z n , we write u x = diag(u A ( 1 ), . . . ,u x ^) G GL n (R((u))). 

2. The general case 

We assume that the reader is familiar with at least the definitions of \2A\ 
3.1-3.27] and [24, 6.1-6.9]. The required results on orders in semisimple 



algebras can all be found in Reiner's excellent [25] ■ In Sections 2.1 through 



2.3 we recall from |24j the general setup of integral models of PEL-type 



Shimura varieties and their local models. 

2.1. PEL data. A PEL datum consists of the following objects. 

(1) A finite-dimensional semisimple Q-algebra B. 

(2) A positivd^] involution * on B. 

(3) A finitely generated left S-module V. We assume that V 7^ 0. 

(4) A symplectic form (•, •) : V X V — > Q on the underlying Q- vector 
space of V, such that for all v,w G V and all b G B the relation 

(bv, w) = (v, b*w) 

is satisfied. 



^By this we mean that the involution on B <g) R arising from * via base-change is a 
positive involution in the sense of [131 §2]. 
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(5) An element J G Ends®iR(F<g>]R) with J 2 + l = such that the bilinear 
form (•, J-) K : Vr x — > R is symmetric and positive definite. 

We also fix the following data. 

(a) A Z-order Ob in 5 such that 0# <S> Z p is a maximal Z p -order in 
B <g>Qp. We assume that 0# ® Z p is stable under *. 

(b) A self-dual multichain £ of 0b <8> Z p -lattices in F <g) Q p . 

Denote by G the group on the category of Q-algebras with 

f /Mx,yeV®R \ 1 

- {, E GL S8R ,V- 8K) I 3t = c(j)6B" ( fe = c(x , J } ■ 

Note that for 5 G G(R), the unit c(<?) G i? x is indeed uniquely determined 
in view of the assumption V ^ and the perfectness of (•,•), justifying the 
notation. We also denote by c : G — > G mj Q the resulting morphism. 

Let A G C. We deviate slightly from the notation of |24j in writing 
A v = {x G Vq p I (x,A)q C !Z p } (in loc. cit. the notation A* is used 
instead). We denote by (•, -)a '-Ax A v — > Z p the restriction of (•, -)q ■ It i s 
a perfect pairing and induces an isomorphism A v — > Homz p (A, Z p ) = A v ' Zp 
of Ob ® Zp-modules, justifying the notation. For A C A' in C we denote 
by pa' A : A — t- A' the inclusion. For b £ (B (£> Q p ) x in the normalizer of 
Ob <g) Zp, denote by A 6 the Ob <S> Zp-module obtained from A by restriction 
of scalars with respect to the morphism CTg <g) Z p — > Ob <3 x t— > b~ 1 xb, 
and let i?a 6 : A b — > bA be the isomorphism given by multiplication with b. 
Then (A, pa'.Aj $a,&> ("> - )a) * s a polarized multichain of Ob <8> Z p -modules of 
type (£) which, by abuse of notation, we also denote by C. 

Let B (g) Qp = .Bi x • • • x Z3 m be the decomposition into simple factors. It 
induces a decomposition 

(2.1.1) B ®Z p = Bl x ••• xO Bm 

and each is a maximal Z p -order in Bi. 

We also get a decomposition V <8> Q p = V\ x • • • x V m into left -Bj-modules 
V{. Denote by Hi the projection of C to V£. It is a chain of O^-lattices in 
Vi- For A G £ we denote by A = Ai x • • • x A m , A* G £{ the corresponding 
decomposition. 

Denote by Vc,±i the (±z)-eigenspace of Jq. Complex conjugation induces 
an isomorphism Vc,« — > Vc-i and consequently 

(2.1.2) dim c Vc,i = dim c Vc,-i = ~z diniQ V. 

Let us quickly recall from \24\ 3.23] the determinant morphism. See |10|. 
2.3] for a more detailed discussion. Let R be a ring, A a (not necessarily 
commutative) i?-algebra and let M be a left A-module which is finite locally 
free as an i?-module. Denote by V = Va the functor on the category of 
-R-algebras with V(S) = A ®r S. We define a morphism detM,A = detM : 
V — > A)j on S 1 - valued points by 

det M (5) : A ® K 5 ^ 5, x ^ det 5 (M 5 ^> M 5 ). 
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For x G A denote by xr{ x \M) the characteristic polynomial of M — > M 
over R. Below we will phrase the determinant condition using characteristic 
polynomials. This is warranted by the following statement. 

Proposition 2.1.3. Let A be a (not necessarily commutative) R-algebra and 
let M and N be A-modules which are finite locally free over R. Let Aq C A 
be a generating set of A as an R-module. Then detjv/ = detAr if and only if 
for all a E Aq we have x_r(o|M) = Xi?(o|A r ) . 

Proof. Clear by the existence of Amitsur's formula [U Theorem A] , which, in a 
suitable sense, expresses the characteristic polynomial of a linear combination 
of endomorphisms in terms of the characteristic polynomials of the summands. 

□ 

As Vc,-j is a B ® C-module we get a morphism dety c _ ; : Vb®c ~~ Ac- 
Consider the reflex field E = Q(trc(6 ® l|Mc)> b G B). The morphism 
dety c _ ; is defined over Oe- Fix a place Q of Oe lying over p. 

2.2. Polarized £-sets of abelian varieties. 

Definition 2.2.1. Let R be an OE Q -algebra. A polarized C-set of abelian 
varieties over R is a pair (A, A), where A = (A\, qa'.a) is ^ n C-set of abelian 
varieties over R in the sense of |24l Definition 6.5], and where A : A — > A y 
is a principal polarization in the sense of |24l Definition 6.6]. We say that 
(A, A) is of determinant dety c _ i if for all A G C we have an equality 

det Li eA A = dety c _ i ®o E R 

of morphisms Vo b ®r — > A^. 

We denote by A the functor on the category of OEa-^Q^bras with A(R) 
the set of isomorphism classes of polarized C-sets of abelian varieties of 
determinant dety c _. over R. 

Remark 2.2.2. After additionally imposing a suitable level structure away 
fromp in the definition of A, we may (and will) assume that A is representable 
by a quasi-projective scheme over Oe q , see [2U Definition 6.9] and the 
discussion following it. We have decided not to include this level structure 
in our notation as it is of no importance for the question of the p-rank on a 
KR stratum. 

Let R be a ring. For an abelian scheme A/R, we denote by Hf R (A/R) 
the first de Rham cohomology of A. It is part of a canonical short exact 
sequence 

(2.2.3) -> u A y -> Hf R {A/R) -> Lie(A) -> 0, 

where oja v C Hf R {A/ R) denotes the Hodge filtration. All terms of (2.2.3) 



are finite locally free i?-modules. We have AjiHf R (A/R) = 2dim^ \A and 
rkflLie(A) = rkfjcj^v = dirriR A. 

Definition 2.2.4. We denote by A the functor on the category of Oe q - 

algebras with A(R) the set of isomorphism classes of pairs (^4,7), where A 
is a polarized C-set of abelian varieties of determinant dety c _. over R and 

7 : Hf R (A) ^ C R 



s 
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is an isomorphism of polarized multichains of Ob ® R-modules of type (£). 

Denote by (p : .4 — )• A the morphism given on R-valued points by A(R) — > 
A(R), (A,j) h- >■ A. 

Aut(£) acts from the left on A via g ■ (A, 7) = (A, 507) and <p is invariant 
for this action. 

Proposition 2.2.5 ( |18l Theorem 2.2]). The morphism <p : A — > A is an 

Aut(£) -torsor for the Stale topology. In particular ip(¥) is an Aut(£)(F)- 
torsor in the set-theoretic sense. 

2.3. The local model diagram and the KR stratification. We will use 
the following obvious variant of [24, Definition 3.27]. 

Definition 2.3.1. The local model M loc is the functor on the category of 
OE Q -algebras with M loc (i?) the set of tuples (t A ) Ae c °f Ob ® R-submodules 
t A C A/2 satisfying the following conditions for all A C A' in C. 

(1) We have Pa',a,_r(^a) C t A >, s ° that we get a commutative diagram 



t A 



tk' 



Y n Y 

. Pa',a,r 

A r ^ A', 



R- 



(2) The quotient Aji/t A is a finite locally free R-module. 

(3) We have an equality 



det 



det 



Vc,- 



Jo 



of morphisms Vq b ®r 

(4) Under the pairing (•, 
t A v pair to zero. 

(5) We have #a,&,k(*a) = 



)a,r ■ A « x A R 



R, the submodules t A and 



tbA f or a H b £ (B 



that normalize 



Remark 2.3.2. We have added the natural condition 2.3.1(5), which seems 
to be missing from [24^ Definition 3.27]. 

Remark 2.3.3. By definition, M loc is a closed subscheme of a finite product 
of Grassmannians. In particular M loc is a projective scheme over Spec0£ Q . 



an E Q-algebra and (t A ) A £ M loc (R). For A G C 
x A r 



Remark 2.3.4. Let R 

the decomposition A = Ai x • • • x A m induces a decomposition t A = t A ,i x 
• • • x t A:m into Osi &> R-submodules t A ^ C A^r. Let i G {1, . . . , m} and 
let A C A' in C with A 

t\,i C t A '^. From condition 2.3.1 (3) we conclude that t A> i and t A . 

= t A ij in view of 2.3.1(2). Consequently 

t Ki- 



ll) we conclude that 
both have 



the same rank over R. Thus £a,i - 
we may unambiguously write t Ai = 

We conclude that the family (t A ) A £c * s determined by the tuple of families 

((iAi)Ais£i>---)(*A n ' 



71 



All conditions of Definition \2.3A with the exception of condition translate 
into independent conditions on the individual (t Ai ). 
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Definition 2.3.5. Denote by tp : A — > Af loc the morphism given on R-valued 
points by 

A(R) -> M loc (R), 
({A A ), (7a)) ^ (7a(w a v)) a . 

Aut(£) acts from the left on M loc via (i^a) • (*a) = (v^aC^a)) an d V> is 
equivariant for this action. 

Definition 2.3.6. XTie diagram 



A 




of Oeq- schemes is called the local model diagram. 

Remark 2.3.7 ([231 Chapter 3], cf. [TBI Theorem 2.2]). The morphisms tp 
and tp are smooth of the same relative dimension. There is, Stale locally on 
A, a section s : A — > A of tp, such that the composition tp o s : A — > M loc is 
etale. 



Consider the decomposition 

M loc (F) = | | M l ° c 

seAut(£)(F)\M loc (F) 

into Aut(£)(F)-orbits. 

Remark 2.3.8. Let x G Aut(£)(F)\M loc (F). The subset M l x oc C M loc (F) 
is locally closed, and we equip it with the reduced scheme structure. By [2H 
Theorem 3.16] the F-group Aut(£)p is smooth and affine. Thus M^ oc is a 
smooth quasi-projective variety over F. 

For x G Aut(£)(F)\M loc (F), we define A x = ^(FJ-^M^ ) and A x = 



(p(¥)(A x )- It follows from Proposition 2.2.5 that the A x are pairwise disjoint 
and cover A(¥) as x runs through Aut(£)(F)\M loc (F). 

Definition 2.3.9. The decomposition 

A(¥) ]J A x 

26Aut(£)(F)\M loc (F) 

is called the Kottwitz-Rapoport (or KR) stratification on A. 

Remark 2.3.10. By Remark pQ7?| th ere is, etale locally on Aw, an etale 
morphism f3 : Aw — > M\ oc with A x = f3- l (M l ° c ) for x G Aut(£)(F)\M loc (F). 
Hence the subset A x C A(¥) is locally closed, and after equipping it with the 
reduced scheme structure, A x is a smooth variety over F. 
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2.4. The p-rank on a KR stratum. 

Lemma 2.4.1. Let A/Q p be a finite simple algebra and let Oa C A be a 
maximal 7L p -order. Then all simple left O A-modules and all simple right 
OA-modules have the same finite cardinality. 

Proof. By |25[ Theorem 17.3] there exist a finite division algebra D/Q p , an 
integer n G N and an isomorphism A ~ M nxn (D) inducing an isomorphism 
Oa — M nxn {Oo)- Here Od C D denotes the unique maximal Z p -order, see 
[251 Theorem 12.8]. 

Denote by p C Od the unique maximal ideal and by k = Od/P the 
corresponding residue field, see |25| Theorem 13.2]. By loc. cit. every simple 
left (resp. right) 0£>-module is isomorphic to k. Hence by Morita equivalence 
(see |25} §§16]) every simple left (resp. right) M nxn {0 £>)-module is isomorphic 
to k n = M nxl (k) (resp. k n = M lxn {k)). □ 

Definition 2.4.2. The multichain C is called complete if for any two neigh- 
bors A C A' in C, the quotient A'/ A is a simple Ob <8> 7L p -module. 

For a finite commutative group scheme G/F, we denote by G e ' u the 
etale unipotent and by G %,m the infinitesimal multiplicative part of G. Let 
rk e , u (G) := rk(G e ' u ) and rk;, m (G) : = rk(G*' m ). 

Lemma 2.4.3. Assume that C is complete. Let (A\, Qa' a) be an C-set of 
abelian varieties overF and let A C A' be neighbors in C Then K = ker qa' A 
is either etale unipotent or infinitesimal multiplicative or infinitesimal unipo- 
tent. 



Proof. The decomposition (2.1.1) induces a decomposition K = K\ x • • • x K m 
into finite locally free group schemes Ki with actions Ob^ — > End 

As A and A' are neighbors, there is a unique io G {1, . . . , m} with Aj C A^ , 
and as C is complete we know that A£ Q /Aj is a simple left 0^ -module. Let 
N = lA^/AjJ. By the definition of an £-set of abelian varieties we know 
that Ki = for i ^ io and that G := Ki has rank over F. 

The action Os io — > EndG induces on G(¥) the structure of a left Ob u - 



module, and as \G{¥)\ < rkG = N, Lemma [2X1] implies |G(F)| e {0,A^}. 
As |G(F)| = ik(G e ' u ), we conclude that G e > u £ {0, G}. 

Denote by D{G) the Cartier dual of G. We also obtain on D(G){¥) the 
structure of a right Os i -module and we analogously obtain that D(G) e,u £ 
{0,D(G)}. As D{G) e ' u °= D{G l ' m ), it follows that G l ' m G {0,G}. □ 

Definition 2.4.4. Let A/W be an abelian variety. Denote by \j>}a '■ A — > A the 
multiplication by p and by A\p] the kernel of [p]a- The integer log„ rk e;U A\p] 
is called the p-rank of A. 

Proposition 2.4.5. Assume that C is complete. Let {Aa, QA',a) be an C-set 
of abelian varieties over F. Let A G C and choose a sequence p~ 1 A = ~D 
A« d • • • d A( fc ) = A of neighbors A^'" 1 ) D A^') in C. Define 

Je,u = {j G {1, . . . , k} | ker q a u-V,aU) is etale}. 
The p-rank of Aa is equal to 

^ logplA^/A^I. 
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Proof. By the definition of an £-set of abelian varieties, there is a periodicity 
isomorphism p -i Ap : A p -i A — > A A such that 

k 

\p)a a = 8p- l K,p ° II Q A U-V, A ti)- 
i=i 

This implies 

k 

Tk e>u A A \p] = J|rk eiU ker£> A ( 3 -i) )A(j ). 
i=l 



Lemma 2.4.3 and the definition of an £-set of abelian varieties yield 

'|AO-D/aO')| ifj€Je, UJ 



rk eiU ker Q A u-i) >A u) 



otherwise. 

□ 



Proposition 2.4.6. Let A = (A A , qa>,a) G A(¥), choose a lift A G A(¥) of 
A under tp(¥) and let (t A ) = i>(¥)(A) G M x ° c . Let A C A' in C. Then 

ker q\i a is multiplicative 
(2.4.7) ' 

PA',A,¥{tA) = t A > 

and 

ker g\r a is etale 
(2-4.8) A/ .' 

<S> A F = impA',A,F + *A'- 

Proof. In view of the definition of ip, the stated equivalences amount to well- 
known characterizations of the respective conditions on ker £>A',A in terms of 
the Hodge filtration inside the de Rham cohomology. □ 

Corollary 2.4.9. Let x G Aut(£)(F)\M loc (F) and (A A , q a , <a ), (A' a , q' a , a ) G 
A x . Let A C A' in C. Then ker £>a',a is etale if and only if ker g' A , A is etale. 

Proof. For (t A ) G M loc (F), the condit ion Ap = impA',A,F + ^A' i s clearly 
invariant under the Aut(£)(F)-action on M loc (F). The claim therefore 



follows from (2.4.8). □ 



Theorem 2.4.10. Assume that C is complete. Let x G Aut(£)(F)\M loc (F) 
and (j4a; £/a',a)> {A' a , q' A i a ) G A x . Let A, A' G C. Then the p-ranks of A A 
and A'k, coincide. In other words, the p-rank is constant on a KR stratum. 



Proof. The p-rank of an abelian variety is an isogeny invariant by |15} p. 
147], so that it suffices to treat the case A = A'. The statement then follows 



from Proposition 2.4.5 and Corollary 2.4.9 □ 



2.5. A formula for the p-rank on a KR stratum. Denote by K the 
completion of the maximal unramified extension of Q p and by Ok the 
valuation ring of K. We identify the residue field of K with F. We denote 
by <7 the Frobenius automorphism on K, inducing the usual Frobenius 
F — > F, x i— > x' p on the residue field. By abuse of notation we also denote by 
a the morphism G{a) : G(K) -> G(K). 
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2.5.1. A p-divisible group analogue. Let Y/F be a p-divisible group. We 
denote by D(Y) the covariant Dieudonne module of Y, see for example [2j. 
It is a free O^-module, equipped with a cr-linear endomorphism Fo and a 
cr -linear endomorphism Vj$, satisfying Fp o Vj$ = Fb> o Vj$ = p. Let Y, Y' be 
p-divisible groups over F and let A : Y — > (y') V De a morphism. It induces a 
pairing (-, -) A : B(Y) x D(F') -> satisfying 



(2.5.1) 



(Fox, y) x = a (x, V a y) x , x G B(Y),y G D(y')- 



We denote by (D(Y), F 5 , V w ) the reduction of B(Y),F n , 
If A/F is an abelian variety let B(A) = B(A\p°°]). 



modulo p. 



Proposition 2.5.2 (pU Theorem 5.11]). 

(1) Let A/W be an abelian variety. There is a canonical isomorphism 

(2.5.3) i = i A : B(A) ^ Hf R (A), 

inducing an isomorphism of short exact sequences 







imVs 



B(A) 



(2.5.4) 



Hf R (A) 



Lie(A[p°°]) ^0 

Lie(A) 



0. 



(2) Let A = (A A ) G A(¥). Fo r A_G £ let i A = l Aa : B(A A ) -> Hf R (A A ) 
be the isomorphism from ( 2,5.3[ ). The resulting morphism 



(2.5.5) 



i = ( tA ) A : (B(A a ))a -> (fTf«(A A )) A 

is an isomorphism of polarized multichains of Ob ® F '-modules of 
type (£). 



In complete analogy with |24l Definition 6.5] and Definition 2.2.1 we have 
the notion of a polarized £-set Y = (Y\, qa',Ai A a ) of p-divisible groups of 
determinant dety c _ t over F. We further obtain a set „4 p _di v (F) of isomorphism 
classes of such Y. In analogy with Definition ; 



2.2.4 



denote by Ap-d\ v (F) the set 
of isomorphism classes of pairs (Y, 7), where Y is as above and 7 : B(Y) — > 
L <S> F is an isomorphism of polarized multichains of Ob <8> F-modules of type 
(£). We have the canonical map <J5 p -div(F) : -4 p _di v (F) — > „4 p _di v (F), (Y, 7) h-> 
Y, and the morphism Vy di v(F) : -4 P - d iv(F) -> M loc (F), (y, 7 ) ^ 7(im%). 



p-div 





-4 



p-div 



By Proposition 2.5.2 we obtain maps 6 : »4(F 
5 : A(F) 



^div(F), (A, 7) ^ (A[p c 



A p . di v(F), A ' y Alp™} and 
701), and the following diagrams 
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commute. 



A{¥) 
A(¥) 



-^p-div(F) 

•^p-div {¥) 5 



A(¥) 
M loc (F) 



Vtp-div(F) 

^p-div(F) 

= M loc (F). 



In absolute analogy with Definition |2.3.9[ we obtain a decomposition 

-^p-div(F) \\ "^p-div,X) 

xeAut(£)(F)\M loc (F) 

which we call the KR stratification on „4 p _ div (F). For x £ Aut(£ )(F)\M loc (F) 
we have A x = ^ _1 (^ P -div,z)- We define as in Definition 2.4.4 the p-rank of 



a p-divisible group over F. The proof of Theorem 2.4.10 then carries over 
without any changes to show the following statement. 

Theorem 2.5.6. Assume that C is complete. Then the p-rank is constant 
on a KR stratum in „4 p _di v (F). 

2.5.2. The map a: A p . div {¥) ^ B^G). 

Lemma 2.5.7. Let Ai and Ai' be polarized multichains of O Ok -modules 
of type (£). Then the canonical map Isom(.M, M'){Ok) — > lsom(M,M')(¥) 
is surjective. In particular Ai and Ai' are isomorphic. 

Proof. Let I = Isom(.M , Ai'). Clearly I is representable by an affine scheme 
over Ok- By p4 3 Theorem 3.16] we know that the base-change T®q k Ok/p 71 
is in particular formally smooth over Ok/p u for every n £ N. This easily im- 
plies the surjectivity of Z(Ok) — > %{¥) in view of I(Ok) = hm ng N^(0 'k / 'p n ) ■ 
The second claim follows, as T(¥) ^ by loc. cit. □ 

For g £ G(K), we denote by g ■ (£ g) O k ) the tuple (g(A ® K ))\eC of 
O b ® O^-submodules of V <g> K. Let I = {g £ G{K) \ g ■ (C ® O k ) = 
C ® Ok] = {g£ G{K) | VA £ C : g(A ® O k ) = A <g> O k } and I = {g £ 1 1 

c(g) = !}• 

Lemma 2.5.8. We have I = O k Iq. In particular, any g £ I satisfies 
c(g)£0 



x 

A ' 



Proof. Let g £ I and A £ C Then A is in particular an Ox-lattice in the 
K- vector space Vk and the fact that g restricts to an automorphism of A 
implies that det(g) £ O k . The equation det(#) 2 = c{g) dhn ® v then yields 
c(g) £ O k . As Ok is strictly Henselian of residue characteristic different 
from 2, there is an x £ O k with x 2 = c(g). Then x~ l g £ Iq, as desired. □ 

Lemma 2.5.9. Let g £ Iq. Then g restricts to an automorphism g\ : 
A ® Ok — > A ® Ok for each A £ C. The assignment g h-> (c/a)a defines an 
isomorphism Iq — > Aut(£)(Ox)- 



Proof. If ((/?a) £ Aut(£)(0i<-), then ip\ <S>o K K is an element of G(K) which 
is independent of A. This provides an inverse to the map in question. □ 
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Proposition 2.5.10 ([211 3.23]). Let Y = (Y A , g A > A , A A ) G „4 p _ div (IF). For 
A £ C let £ A : D(1a) x IJ(^A v ) — > Ok be the pairing induced by \\. Then 
(D(Ya))a, equipped with the pairings (£a)a, is a polarized multichain of 
Ob ® Ok -modules of type (£). 

Define equivalence relations ~ and ~/ on G{K) by 

x ~ y :<S> 3g G G(A') : y = gxa{g)" 1 , 

x ~/ y :44> 3i G / : y = ixcr(i) _1 

and denote by B(G) = G(K)/ ~ and Bj{G) = G{K)/ ~/ the corresponding 
quotients. For an element b G G(K), we denote by [b] its equivalence class 
in B(G). 



Let {Y\) G ^4 p _div(^)- By Lemma 2.5.7 there is an isomorphism <p = 
{ ( Pa)a '■ (II5(^a))a — > £■ ® Ok of polarized multichains of Ob <8> O^-modules 
of type (C). Let A G C. Then 3a = fk° Fooip^ 1 is a cr-linear endomorphism 
of A <g> O/^. By functoriality of the Dieudonne module, the base-change 
3a ®Ok : U (g> -ftT — > V ® K is independent of A and we simply denote it 
by In the same way we obtain from the morphisms Vd on the Dieudonne 
modules a o~~ 1 -linear endomorphism QJ of V (8> ^ • 

Let 6 = ^ o (idy <g> o-)" 1 . Th en b is a B ® .fT-linear endomorphism of 
V <S> K , and in view of ( |2.5.1 ) we have 6 G G(K), with c(6) = p. If 



: (D(Ya))a — > £ <8> Oft" is another isomorphism, we have ip' = i o tp for 
some i G Jo, and the resulting element b' G G(K) will satisfy 6' = ibo-{i)~ l . 
In this way we obtain a well-defined map a : -4. p -div (IF) —> Bi(G). 

The canonical projection G(K) — > I\G{K)/I factors through B[(G), so 
that we obtain a map Bj(G) can '> I\G(K)/I . Denote by 7 the composition 
-Vdiv(F) A Bj(G) ^> I\G(K)/I. Denote by Perm C I\G(K)/I the 
image of 7. By abuse of notation, we also denote by 7 : *4 p _div(IF) Perm 
the induced map. 

Denote by Bj(G)p erin C Bj(G) the preimage of Perm under the canonical 
map Bi(G) I\G{K) / 1 . By abuse of notation, we also denote by 

a : Ap-div(^) — > Bj(G)p eTm the induced map. The situation is visualized by 
the following commutative diagram, in which the square is cartesian. 

Bl (G) caJ1 " > I\G{K)/I 
^p-div(F) — ^- -B/(G) Porm ca11, > Perm 




The following two results show that the map a : ^4 p -divC^) — > Bj(G)p erra is 
very close to being a bijection. Our proofs are based on the discussion of the 
Siegel case by Hoeve in [TTJ Chapter 7]. 

Proposition 2.5.11. The map a : A p -div(^) — > Bj(G)p eTin is surjective. 
Proof. Let b G Bj (G) p C r m and pick any representative b G G(K) of b. By 



(2.5.1 ) and Lemma 2.5.8 there is a unit v G O k with c(b) = vp. Using Lang's 



K 

X 



Lemma in combination with an approximation argument, we find a u G O k 
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with v = (ua(u) 1 ) 2 . After replacing b by u l ba(u), we may assume that 
c(6) = p. 

Define £ = bo (idy ®cr) and 23 = pff -1 . Let A E £. Then A® is stable 
under J and QJ, and we denote by 3a and 03a the induced endomorphisms of 
A (g> 0a- Dieudonne theory implies that the chain ((A ® 0a, 3a, 5Ja), PA', a) 
is of the form B(Y) for an £-set Y = (Y\, QA',a) °f p-divisible groups of 
determinant dety c _ 4 over F. 

From c(fe) = p, we obtain 

compare (2.5.1). Dieudonne theory then implies that (-, Oao ^ s induced by 



an isomorphism \\ : Ya - > Y\v, and the tuple A = (Aa) provides us with a 
polarization of Y. The isomorphism class of (Y, A) is the desired preimage of 
b under a. □ 

Proposition 2.5.12. Let Y = (Ya, £>A',A> Aa) and Y' = (Y A , g' A , A ,A A ) 6e 
two points o/^4 p _div(F). T/ien a(Y) = a(y') i/ and only if there exist both 
an isomorphism 4> = (0a) : (Ya, qa',a) (Y A , q' a , A ) of L- sets of p- divisible 
groups over F and a unit u £ such that the following diagram commutes 
for all A G £. 



vV 7 AV y/V 
r A v r A v - 



Proo/. Choose isomorphisms <p : B(Y) ^> L®O k and 99' : D(F') ^> C®O k , 
and denote by 6 and 6' the resulting elements of G(K) as above. If a(Y) = 
a(Y'), there is an i £ I with b' = ibo~(i) . We have seen above that 
c(b) = p = c(b f ), so that c(i) = a(c(i)). By Lemma [2.5.8 and [T21 Lemma 



2.5.9 



we consider i 



1.2], the element u := c(i) lies in Z*. As in Lemma 
as a tuple of endomorphisms (A ® a — >■ A (g) 0a)a££- The composition 
y/ -1 o j o (p corresponds under Dieudonne theory to the desired morphism cf>. 
Similarly for the converse. □ 

2.5.3. The map 7 and the KR stratification. 

Proposition 2.5.13. Two points Y,Y' G -4 p _di v (IF) lie in the same KR 
stratum if and only if 7(A) = r )(A'). 

Proof. The map G(K) — > G{K), g \-t po~^ 1 (g^ 1 ) descends to a well-defined 
bijection r : I\G{K)/I — > I\G(K) / 1 , and it suffices to show the correspond- 
ing statement for the composition .Ap_ div (F) I\G(K)/I -H> I\G{K)/I 
instead of 7. 

Let Y = (Ya)a G -4p-div(F). Choose an isomorphism tp : (B(Ya))a — >• jC ® 
Ok and denote by 5 and 5J the resulting endomorphisms of V ® K, as above. 
Let b G G(K) with 5= 60 (idy ® a). We have 03 = pcr" 1 (^ 1 ) o (idy ® o^ 1 ), 
so that 2J(A®O k ) = pa -1 ^- 1 )^ ® 0a), A g £. 

For A £ £, denote by -zta : A (g) 0a — s- A (g> F the canonical projection. 
For a tuple M = (M A )Ae£ of O s <g> 0A-submodules pA <g> a C M a C 
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2.5.7 



A® O k further write vr(M) = (7Ta(Ma))a- Note that M and n(M) mutually 
determine each other. 

By definition the KR stratum that Y G «4 p _di v (F) lies in is given b y the 
Aut(£)(F)-orbit of the point vr((23(A ® O k )) a ) G M loc (F). By Lemma" 
Lemma |2. 5.8 and Lemma |2.5.9[ this orbit is equal to 

irdipa- 1 ^- 1 ) ■(C®0 K )\ie I}). 

We conclude by noting that for an element g G G(K), the set {ig ■ (£(S>Ok) \ 
i £ 1} and the image of g in I\G(K)/I mutually determine each other. □ 

Definition 2.5.14. For x G Perm, we denote by ^4 p _div,a; = 7 _1 ( x ) an d 
A x = S~ 1 (A p -div,x) the corresponding KR stratum in A p -di v (¥) and A(¥), 
respectively. 

Remark 2.5.15 (Compare 11.3]). The normalization of Definition 



2.5.14 amounts to indexing the KR stratification by the relative position of X(8> 



Ok to its image under Frobenius. This seems to be the natural normalization 



in the current context, see in particular Remark 2.5.22 below. In the context 
of affine flag varieties however, to be explained in the following sections, the 
natural normalization seems to be by the relative position of C ® Ok to its 
image under Verschiebung, see for example Remark \3. jO , This amounts 

to replacing the map 7 by the composition A{¥) I\G(K)/I — — — — ^> 



I\G(K) 1 1 , as we have for example done in the proof of Proposition 2.5.13 
Let us note that for the question of the p-rank on a KR stratum both 
normalizations yield the same results. 

Denote by r p : „4 p _di v (F) — > N the map with 7j,((Ya,)a) equal to the common 
p-rank of the Y\. In view Proposition 2.5.13 Theorem |2.5.6| amounts to the 



following statement. 

Theorem 2.5.16. Assume that C is complete. The map r p : *4. p _div(F) — > N 
factors through -4. p _div(F) -h Perm. 

2.5.4. The Newton stratification. The canonical projection G(K) — > B(G) 
factors through Bj(G), so that we get a map Bi(G) -^-^ B(G). Denote by 
P the composition A p . div (¥) ^ B T (G) ^ B(G). 

Definition 2.5.17. Let b G B(G). We define N p . div , b := C «4 p -di v (F) 

and Mb '■= (/3 o C »4.(F), and call it the Newton stratum associated 

with b in -4 p _div(F) and A(¥), respectively. 

Denote by D the diagonalizable affine group with character group Q over 
K. Let b G G(K). We denote by u b : B — > Gk the corresponding Newton 
map, defined in [12t 4.2] The morphism u b makes Vk into a representation 
of D and we consider the corresponding weight decomposition Vk = ©xgQ^x- 
We define 

i/ b)0 := dim K V . 

If g G G(K), we know that v gba ^-i = Int(g) o v b , where Int(g) : G(K) — > 
G(K), h 1 y ghg~ l , and consequently = f g ba{g)- x fl- Thus the map 



2 Note that the discussion in loc. cit. still remains valid for not necessarily connected 
reductive groups over Q p . 
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G(K) — >• N, b h-> Vb,o factors through B(G), and we also denote by B(G) — > 
N, b i — ^ the resulting map. 

Proposition 2.5.18. TTie map r p : *4p_div(F) - * N factors as 

-4p-div(F) A 5(G) ^> N. 

In other words, for b G B{G) the p-rank on Mb is constant with value u^fi- 

Proof. This follows from the fact that the isotypical component of slope in 
D(G) ®o K K comes precisely from the etale part of G, see for instance [2, 
IV]. " □ 

Assume from now on that C is complete. We can summarize the 
above discussion in the following commutative diagram, with the dotted 



arrow coming from Theorem 2.5.16 



(2.5.19) 



A>div(F) £/(G0pc rm -^V Perm 



B(G) — N 




Definition 2.5.20. Let b G G(K) and x G I\G{K)/I. The affine Deligne- 
Lusztig variety associated with b and x is defined by 

X x (b) = {g G G{K)/I | g- l b<y{g) G Ixl}. 

Proposition 2.5.21. Let x G Perm and b G G(K). Then the following 
equivalence holds. 



X x (b) + ^ .Ap-div,^ nA/p. diVi[6] / 0. 



□ 



Proof. Follows from the definitions and Proposition |2 . 5 . lTj 

Remark 2.5.22. Let x G Perm and let b G G{K). Although not established 
in full generality, it is expected that the following equivalence holds, see [7, 
Proposition 12.6]. 

(2.5.23) X x {b)^$^A x nN [b] 7^0. 

The difficulty in proving this equivalence lies in the construction of a suitable 
C-set of abelian varieties with prescribed C-set of p-divisible groups. For 
recent progress in the unramified case due to Viehmann and Wedhorn see 

m 



Theorem 2.5.24. Let x G Perm and let b G G(K). Assume that X x (b) / 0. 
Then the p-rank on A p .dn,x ( and a fortiori on A x ) is constant with value 
u [b],0- 



Proof. Clear from Proposition 2.5.21 Theorem 2.5.16 and Proposition 2.5.18 

□ 
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Remark 2.5.25. We expect that I C G(K) is an Iwahori subgroup. This 
is true in the situations to be studied in the following sections, and would 
provide a more natural view on the set I\G{K)/I occurring above as we 
could then identify it with a suitable extended affine Weyl group, see |2CH 
Appendix]. Proving this statement seems to require a case-by-case analysis. 
The case of a ramified unitary group has been studied in |21l §1.2], and the 
case of the orthogonal group has been investigated in [28, §4.3]. 

2.6. A combinatorial lemma. The following combinatorial result explains 
the relationship between the abstract formula of Theorem 2.5.24| and the 
more concrete formulas of the following sections. 

Let n G N and consider the canonical semidirect product W := S n ix IT 1 . 
Let H be a finite cyclic group of order / with generator a. We have the shift 
IlgeH W ~~ * Il^es W> ( x ?)? ^ ( x cr- if)^- By abuse of notation, we simply 
denote it by a. 

Lemma 2.6.1. Let (w^)^ G IlgeH ^ n an ^ (^?)$ G Il^es^™- Assume that 
for all £ 6S and all 1 < i < n, the following statement holds. 

(2.6.2) Af(i) > and (A^(i) = => w^{i) < i). 

Let x = (w f u A «) ? G Yl^W. Choose N G N>i such that W^l^ 1 cr k {x) G 
n§eH^™- Consider the element 

1 AT/-1 

- = = n ^ 

J k=0 

of n§esQ>o- 27zen for each I < i < n, the following statements are 
equivalent. 



(1) 3£ G 3 

(3; ve G 3 



^(i) = 0. 
= 0. 

(w^(i) = i A A^(z) = 0). □ 
3. The symplectic case 



3.1. Number fields. We first fix some notation concerning (extensions of) 
number fields. Let K/Q be a number field. We will always denote by Ok the 
ring of integers of A'. If V is a nonzero prime of Ok, we will always denote 
by k-p = Ok/V its residue field and by pp : Ok — > kp the corresponding 
residue morphism. We further denote by Kp the completion of A with 
respect to V and by Ok v the valuation ring of Kp . 

Let Ao/Q be a number field and assume that pOk = Vq° for a single prime 
Vq of Ok and some eo G N. Denote by So the set of all embeddings Kq C. 
Fix a finite Galois extension L/Q with Kq C L and write G = Gal(L/Q) 
and Ao = Gal(L/Ao). Fix a prime Q of Ol lying over Vo and denote by 
Gq C G the corresponding decomposition group. 

Lemma 3.1.1. There is a unique map 70 = 7p : So — )• Gal(kp /¥ p ) 
satisfying 

(3.1.2) Vcr G S Va G Ox : PQ^W) = 7o(<r)(P7>o( a ))- 

A is surjective and all its fibers have cardinality eo ■ 
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Proof. Left to the reader. □ 

Let K/Kq be a quadratic extension. Denote by * the non-trivial element 
of Gal(K/Ko). Assume that VqOk = V+P- for two distinct primes V+,V- 
of O k , say Q n O k = V+. Consequently V- = V%. Denote by a : G ->• E 
the restriction map. Fix a lift t, £ G of * under a. Define subsets E± C E 
by E+ = a(G Q H) and S_ = a(G Q T*H). Then E = S+ II E_. We identify 
A>P ± with £>p via the isomorphism induced by the inclusion Ok C 

Lemma 3.1.3. There are unique maps j± : E± — > Gal(fep /F p ) satisfying 

(3.1.4) G E±Va G 0^ : p Q (a(a)) = 10 {a\ Ko ){p r± {a)). 

Proof. Left to the reader. □ 

3.2. The PEL datum. Let g,n G N>i. We start with the PEL datum 
consisting of the following objects. 

(1) A totally real field extension F/Q of degree g. 

(2) The identity involution id^ on F. 

(3) A 2n-dimensional F-vector space V. 

(4) The symplectic form (•,•): V x V — ^ Q on the underlying Q-vector 
space of V constructed as follows: Fix once and for all a symplectic 
form (•, ■) : V x V — > F and a basis (£' = (e' 1; . . . , e' 2n ) of V such 
that (■, ■) is described by the matrix J 2ra with respect to (£'. Define 
(-,-) = tr F/Q o (.,.)'. 

(5) The F <g) M-endomorphism J of V <8> R described by the matrix — J 2ra 
with respect to <£'. 

Remark 3.2.1. Denote by GSp^. .y i/te F-group of symplectic similitudes 
with respect to (•, ■)', and 6y c : GSp^. .y — > G m the factor of similitude. Then 
the reductive <Q-group G associated with the above PEL datum fits into the 
following cartesian diagram. 

G c *- RespyQ GSp^.y 

c c 
Y y 

G m ,Q C >■ Res f/q G rrij F- 

We assume that pOp = V e for a single prime V of Op. Denote by / = [k-p : 
F p ] the corresponding inertia degree, so that g = ef. We have F <S> Qp = F-p 
and Of ®7L v = Of v - Fix once and for all a uniformizer it of Op (8) Z( p ). 

Denote by € = to F \L V the inverse different of the extension Fp/Q p . Fix 
a generator 5 of it over Opp and define a basis (ei, . . . , e2 n ) of Vq over 
by a = e-, e„ +i = <5e^ +i , 1 < i < n. 

Let < z < 2n. We denote by Aj the d?Pp -lattice in Vq with basis 

€j = (7r _1 ei, . . . , 7r _1 ej, e i+ i, . . . , e 2n ). 

For A; G Z we further define A 2ra fc_|_j = 7r _fc Aj and we denote by G^nfc+i the 
corresponding basis obtained from <£j. Then £ = (Aj)j is a complete chain of 
Of v -lattices in V. For % G Z, the dual lattice AV := {x G Vq p | (x,Aj)q C 
Zp} of Aj is given by A_j. Consequently the chain C is self-dual. 
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Let i£Z. We denote by pi : Aj — > Aj+i the inclusion, by #j : A2 n + , — )• Aj 
the isomorphism given by multiplication with ir and by (•, -)j : Aj x A— i ~~ ^ 
the restriction of • Then (Aj, /9j, $j, (•, is a polarized chain of 

Op v -modules of type (£), which, by abuse of notation, we also denote by C. 

Denote by (•, •) i : Aj x A_j Of v the restriction of the pairing 5~ l (•, -)q . 

It is the perfect pairing described by the matrix J2 n with respect to the bases 
<£i and (£_j. 

3.3. The determinant morphism. Denote by £ the set of all embeddings 
F <—)■ C. The canonical isomorphism 

(3.3.1) F©C=JJC 

o-es 

induces a decomposition V © C = Oo-eE ^ into C-vector spaces V a , and the 
morphism Jc decomposes into the product of C-linear maps J a : V a — > V a . 
Each J rj induces a decomposition V a = V a> i ffi V^-j, where V a ^±i denotes the 
±z-eigenspace of J a . From the explicit description of J in terms of B above 
one sees that both V a i and V a -i have dimension n over C. 

The (-i)-eigenspace V-i of J c is given by V-i = fLeE ^-»,<r- As dim c F_j ;CT 
= n for all cr, there is an isomorphism V-i ~ (Y\ a C) n of JT CT C-modules and 



hence the 0^ © C-module corresponding to K-j under (3.3.1) is isomorphic 
to O f © C. In particular, the morphism dety_ i : Vo F ®c ~~ ^ &c is defined 
over Z. 



3.4. The local model. For the chosen PEL datum, Definition 2.3.1 amounts 
to the following. 

Definition 3.4.1. The local model M loc is the functor on the category of 
Zp-algebras with M loc (i?) the set of tuples (ii)iez of Of © R-submodules 
ti C Aj ; R satisfying the following conditions for all i G Z. 

(V Pi,R,{ti) C fi+i. 

T7ie quotient Km/ti is a finite locally free R-module. 

(c) We have an equality 

det KR/U = det v_, ©-R 

o/ morphisms Vo F ®R 

(d) Under the pairing (•, ■) i R : A^r x A-^ij — >■ i?, i/ie submodules ti and 
t—i pair to zero. 

(e) fiifon+i) = U. 

3.5. The special fiber of the local model. For i G Z, denote by Aj 
the F[u]/u e -module (¥[u]/u e ) 2n and by (£j its canonical basis. Denote by 
(•,•}« : Aj x A_j — > ¥[u]/u e the pairing described by the matrix Jm with 
respect to (£j and (£_j. Denote by ^ : A2 n +j — > Aj the identity morphism. 
For G Z and < i < 2n, let p 2 n+j : A2 n +i — >• A2 n +j+i be the morphism 
described by the matrix diag(lW,«, iC 2 ™-*- 1 )) with respect to <£2nfc-M an d 
^2nfe+i+l- 

Definition 3.5.1. Let M e,n be the functor on the category ofF-algebras with 
M e ' n (R) the set of tuples (ii)igz of R[u]/u e - submodules ti C A^r satisfying 
the following conditions for all i G Z. 
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(a) Pi,R(U) C t i+lL 

(b) The quotient A^r/U is finite locally free over R. 

(c) For all p E R[u]/u e , we have 

XR(p\A l ,R/U) = {T-p(0)) ne 

in R[T}. 

(d) tf'^ = u. 

(e) l?i(*2n+i) = U- 

Denote by 6 the set of all embeddings k-p ^ F. Our choice of uniformizer 
7T induces a canonical isomorphism 

(3.5.2) O f ® F = ]J F[u]/(u e ). 

o-es 



Let i £ Z. From (3.5.2) we obtain an isomorphism 
(3.5.3) A i)F = [] A, 

(T66 

by identifying the basis G^f with the product of the bases Under this 
identification, the morphism p^p decomposes into the morphisms p i: the 
pairing decomposes into the pairings (•,•)* an d the morphism i?^ 

decomposes into the morphisms $j. 

Let i? be an F-algebra and let (ii)jgz be a tuple of Of ® i?-submodules 
U C Aj^. Then (3.5.3) induces decompositions = Oo-ee^. " R[u]/u e - 
submodules ij jCr C A^ij. 

Proposition 3.5.4. T/ie morphism M^ c — > Y\a&6 M e,n given on R-valued 
points by 

M^ oc {R) -> JJ M e ' n (i?), 
(3.5.5) o-66 

(ti) ^ 

is an isomorphism of functors on the category of ¥ -algebras. 

Proof. The only point requiring an argument is the transition from (•, ■) i 
to (•, It is warranted by the perfectness of the pairing Of v x Of v — > 
%p, (x,y) i-> tr Fv /Q p (5xy). □ 

3.6. The affine Grassmannian and the affine flag variety for GL n . 
Let R be an F-algebra and let n E N. 

Definition 3.6.1. A lattice in R((u)) n is an R\u\-submodule L C R((u)) n 
satisfying the following conditions for some N E N. 

(1) u N R{uJ n CLC vr N R{u] n . 

(2) u~ N R\u\ n / L is a finite locally free R-module. 

The following statement is well-known. See for example jlOi Proposition 
4.5.5] for a proof. 

Proposition 3.6.2. Let L be a lattice in R((u)) n . Then L is a finite locally 
free R\u\-module of rank n. 
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Definition 3.6.3. The affine Grassmannian Q is the functor on the category 
of F-algebras with G{R) the set of lattices in R((u)) n . 

Denote by Ao = -R[iiJ n the standard lattice. Clearly LGL n (i?) acts on 
G(R) by multiplication from the left, and the stabilizer of Ao for this action 
is given by L + GL n (i2). Consequently we get an injective map 

cft(R) : L GL n (R)/L+ GL n (R) -> Q (R) 

9 >->• fiA . 

It is equivariant for the left action by LGL n . 

Proposition 3.6.4. The map (ft identifies Q with both the Zariski and the 
fpqc sheafification of the presheaf L GL n / L + GL„. 



Proof. By Proposition 3.6.2| it is clear that any lattice lies in the image of 



(ft Zariski locally on R. It follows that (ft is the Zariski sheafification of the 
presheaf L GL n /L + GL n . The fact that Q is already an fpqc sheaf implies 
formally that (ft is also the fpqc sheafification of the presheaf L GL n / L + GL n . 

□ 

Definition 3.6.5. A (complete, periodic) lattice chain in R((u)) n is a tuple 
{Li)i£% of lattices Li in R((u)) n satisfying the following conditions for each 
i € Z. 

(1) U, C L i+1 . 

(2) (completeness) Li + \/Li is a locally free R-module of rank 1. 

(3) (periodicity) L n+ i = u v Li. 

Definition 3.6.6. The affine flag variety J- is the functor on the category of 
¥ -algebras with J~(R) the set of (complete, periodic) lattice chains in R((u)) n . 

Denote by (e±, . . . ,e n ) the standard basis of R((u)) n over R((u)). For 
< i < n we denote by A» the lattice in R((u)) n with basis 

<£i = (u _1 ei, . . . , u _1 ej, e i+ i, ...,e n ). 

For k G Z we further define A n k+i = u~ k Ai and we denote by £ n k+i the 
corresponding basis obtained from £j. Then C = (Aj)j is a (complete, 
periodic) lattice chain in R((u)) n , called the standard lattice chain. 

In complete analogy with \24\ p. 131], we have for an F[n]-algebra R 
the notion of a chain M. = {Mi, Qi : Mi — > Mj + i, 9i : M n+ i — > Mi)i^% of R- 
modules of type (£) (cf. PU Definition 7.5.1]). The proof of [Ml Proposition 
A. 4] then carries over without any changes to show the following result. 

Proposition 3.6.7. Let R be an F[u] -algebra such that the image of u in 
R is nilpotent. Then any two chains M,M of R-modules of type (£) are 
isomorphic locally for the Zariski topology on R. Furthermore the functor 
Isom(.M, Af) is representable by a smooth affine scheme over R. 

Proposition 3.6.8. Let R be an ¥ -algebra and let Ai,M be chains of 
R\v\-modules of type (£). Then the canonical map Isom(7W, A/")(-R[u]) — >• 
Isom(.M , N){R\u\/u m ) is surjective for all m G N>i. In particular M and 
N are isomorphic locally for the Zariski topology on R. 
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Proof. Analogous to the proof of Lemma 2.5.7 □ 



Remark 3.6.9. Let R be an ¥ -algebra and let G J-(R). For i G Z 

denote by q% : Li — )• Lj+i the inclusion and by 9i : L n +i —> Li the isomorphism 
given by multiplication with u. Then (Li,Qi,9i) is a chain of R\u\-modules 
of type (£). 

Remark 3.6.10. The group LGL n (i?) acts on J-(R) via g ■ (Lj)j = {gLi)i. 
Denote by L(R) the stabilizer of C for this action. One checks that L(R) C 
GL n (i?[u]) is equal to the preimage of B(R) under the reduction map 
GL n (R{uj) -)• GL n (R), u ^ 0. Here B(R) C GL n (R) denotes the sub- 
group of upper triangular matrices. 

We obtain for each F-algebra R an injective map 

LGL n (R)/I(R)^%T(R), 
g i > g • £. 



Proposition 3.6.11. The morphism eft identifies J- with both the Zariski 
and the fpqc sheafification of the presheaf L GL n / I . 

Proof. Let R be an F-algebra and let Ai G J-(R). We consider Ai as a c hain 

the 



3.6.8 



of -Rf/u] -modules of type (£) as in Remark 3.6.9. By Proposition 
chains C and Ai are isomorphic locally for the Zariski topology on R. Such an 
isomorphism C — > M. is given by multiplication with a single g G GL n (]?[«]]). 
Consequently Ai lies in the image of 4> Zariski locally on R. The fact that T 
is already an fpqc sheaf implies formally that <p is also the fpqc sheafification 
of the presheaf L GL n /J. □ 

3.7. The affine flag variety. This section deals with the affine flag variety 
for the symplectic group. Our discussion loosely follows the one in \19\ 
§10-11]. Note though that in loc. cit. there is a minor problem with the 



definition of the notion of self-duality for lattice chains, see Remark 3.7.9 
below. We have learned the correct formulation of this definition from [26|, 
§4.2], which deals with the case of a ramified unitary group. 

Let R be an F-algebra. Let (•, •) be the symplectic form on R((u)) 2n 
described by the matrix Jm with respect to the standard basis of R((u)) 2n over 
R{(u)). We denote by Sp = Sp 2n the symplectic group and by GSp = GSp 2n 
the group of symplectic similitudes with respect to (•,•). 

For a lattice A in R((u)) 2n we define A v := {x G R((u)) 2n \ {xJV) C R{uj}. 

the standard lattice chain C = (Aj)j in R((u)) 2n . Note 



3.6 



Recall from Section 
that (Aj) v = A_j for all i £ Z. We denote by (•, : Aj x A_j -> R{uJ the 
restriction of (•,•). 

In complete analogy with |24| Definition 3.14], we have for an F[u]-algebra 
R the notion of a polarized chain At = (Mi, Qi : Mi — > M^+i, 0< : M2 n +i — > 
Mi, Si : Mi x M_i -)■ R)izz of -R-modules of type (£) (cf. [TOl Definition 
5.5.1]). The proof of [241 Proposition A. 21] then carries over without any 
changes the show the following result. 
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Proposition 3.7.1. Let R be an F\u\-algebra such that the image of u in 
R is nilpotent. Then any two polarized chains M,M of R-modules of type 
(C) are isomorphic locally for the Zariski topology on R. Furthermore the 
functor Isom(.M, M) is representable by a smooth affine scheme over R. 

Proposition 3.7.2. Let R be an ¥ -algebra and let Ai,M be polarized chains 
of R\u\-modules of type (£). Then the canonical map Isom(.A/f, N)(R\u\) — > 
Isom(.A/f, M)(R\u\/u m ) is surjective for all m G N>i. Ln particular M. and 
J\f are isomorphic locally for the Zariski topology on R. 



Proof. Analogous to the proof of Lemma 2.5.7 □ 

The following definition is a straightforward variant of [261 §4.2]. 
Definition 3.7.3. Let R be an F-algebra and let (Lj)j be a lattice chain in 

(1) Let r G 7L. The chain (Lj)j is called r-self-dual if 

Vi G Z : V( = u r L-i. 

(r) (r) 

Denote by Jg p the functor on the category of¥-algebras with Jg p (R) 
the set of r-self-dual lattice chains in R((u)) 2n . 

(2) The chain is called self-dual if Zariski locally on R there is an 
a G R((u)) x such that 

(3.7.4) Vi G Z : L\ = 

We denote by Jx^Sp the functor on the category of F-algebras with 
•7"GSp(i?) the set of self-dual lattice chains in R((u)) 2n . 

Note that £g J$jj(R). 

Lemma 3.7.5. Let R be a ring and let a G R((u)) x . Then Zariski locally on 
R, there are integers n < no, nilpotent elements a n , a n +i, ■ ■ ■ , a no -i G R, a 
unit a no G R x and elements a no +i> a n +2, ■ ■ ■ G R such that a = <H V > % . 
Lf Spec R is connected, such integers and elements exist globally on R. 

Remark 3.7.6. Let R be a reduced F-algebra such that Spec R connected. 
Then 



T GSp (R) = \J^J(R). 



Proof. This follows immediately from Lemma |3.7.5| □ 

Remark 3.7.7. Let R be an F-algebra and let G F^(R). For i G Z 

denote by Qi : Li — >■ Lj+i the inclusion, by Q{ : L2 n +i — > Li the isomorphism 
given by multiplication with u and by £{ : Lj x — > RfuJ the restriction of 
(•,•). Then (Li, Qi,0i,£i) is a polarized chain of R\u\-modules of type (£). 

Recall from Remark |3.6.10| the subfunctor / C L GL2 n . We define a 
subfunctor / G S P = ^GSp 2n of L GSp = L GSp 2n by L GSp = L GSp 2n n /. We 
consider all of these functors as functors on the category of F-algebras. 

The proof of the following result is similar to and therefore based on the 
proof of |20[ Theorem 4.1]. 
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Proposition 3.7.8. The natural action o/LGL2 n on J 7 (cf. Remark 3.6.10) 
restricts to an action o/LGSp on -Fcsp- Consequently we obtain an injective 
map 

LGSp(R)/I GSp (R) ^> T GSp (R), 



9 ' > 9 ■ £ 

for each F-algebra R. The morphism (p identifies JxjSp with both the Zariski 
and the fpqc sheafification of the presheaf L GSp/IcSp- 

Proof. Let R be an F-algebra and let M = G ^XJSpC-R)- Working 

Zariski locally on R we may assume that there is an a G i?((u)) x such that 



(3.7.4) holds. Choose any h G GSp(i?((u))) with factor of similitude a, e.g. 
h = diag(a( n ),l( n )). An easy computation shows that hM. G T^(K). We 



see as in the proof of Proposition 3.6.11 that Zariski locally on R, there is a 



g G Sp(i?((n))) with hM = gC. Consequently M. = h~ 1 gC lies in the image 
of (f> Zariski locally on R. As J~GSp is clearly a Zariski sheaf, it follows that 
JxiSp is indeed the Zariski sheafification of the presheaf LGSp/Icsp- 

To see that J^GSp is also the fpqc sheafification of LGSp/Icsp; it suffices 
to show that JxJSp is an fpqc sheaf. Let (Lj)j be a lattice chain in R((u)) 2n . 



Assume that fpqc locally on R there is an a G R((u)) x such that (3.7.4) holds. 
The scalar a gives rise to a well-defined element of (L G m / L + G m )f pqc (i?), 
where (LG m /L + G m )f pqc den otes th e fpqc sheafification of the presheaf 



LG m /L + G m . By Proposition 3.6.4 any element of (LG m /L + G m )f pqc (i?) 



can be represented in ~LG m (R) Zariski locally on R, so that the scalar a 
exists in fact Zariski locally on R. □ 

Remark 3.7.9. Let us note that there seems to exist a misconception sur- 
rounding the notion of self- duality for lattice chains. In the literature one finds 
the following definition: Let R be an F-algebra. A lattice chain (Lj)j G ^(R) 
is called (naively) self-dual if for each i G Z there is a j G Z such that 
V( = Lj. It is then claimed that the fpqc local LGSp-orbit of £ (in the sense 



of Proposition 3.7.8) is precisely the set of (naively) self-dual lattice chains. 



This is wrong in both directions, as shown by the following easy examples. 

• Let n = 1 and a G R((u)) x . The chain (Li)i = aC satisfies V( = 
a~ 2 L_i, i £ Z. Assume there is a j G Z with Lq = Lj. Then a~ 2 Lo = Lj 
and hence a~ 2 Ao = Aj. Projecting this equality inside R((u)) 2 to its first 
components yields the existence of a k G Z with a~ 2 R{u} = so 
that u k a 2 G -R[^] x ■ If for example R = F[x]/x 2 and a = 1 + xu~ l , such a 
k does not exist. 

• Conversely one easily sees that for n > 2, the (naively) self-dual chain 
(Aj + i)j e z does not lie in the LGSp(R)-orbit of C (unless R = {0}). 

3.8. Embedding the local model into the affine flag variety. Let R 

be an F-algebra. We consider an R[u] /u e -module as an i?[u] -module via the 
canonical projection RfuJ — > R[u]/u e . For i £ Z denote by a% : Aj — )■ Aj^ 
the morphism described by the identity matrix with respect to (£« and (Ej. 
It induces an isomorphism Aj/u e Aj — > Aj#. Clearly the following diagrams 
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commute. 



A; 



c A,- 



i+l 



Aj x A_ 



<v>< 



A; 



A 



2n+i 



A 



Pi,R 



(Xi+1 OiXQ_ 



i,R 



A 



i+l,R, 



A iiR x A^ i)R ^ i?[u 



A 



02n + i 



i,R 



A. 



2n+i,R- 



The following proposition allows us to consider M e,n as a subfunctor of 



XT 



(-e) 



Sp 



Proposition 3.8.1 ([19, §11]). There is an embedding a : M e ' n T<. 



(-e) 
Sp 



r(-e)/ 



given on R-valued points by 

M^{R)^F^ e \R), 

(u)i -> K rl (*i))i- 

It induces a bijection from M e,n {R) onto the set of those {Li)i 6 J-g 6,1 (i?) 
satisfying the following conditions for all i E Z. 

(%) n e Ai C Li C A*. 

For a// p € R[u]/u e , we have 

X R(p\A t /L l ) = (T-p(0)r 
in R[T]. Here Aj/L^ is considered as an R[u]/u e -module using (1). 

Proof. Let (ti)i £ M e ' n (R) and set (L^ = (af 1 ^))*- Xt is clear that this 
defines a periodic lattice chain in R((u)) 2n . Let i £ Z. We have 

(3.8.2) rk^Ai+i/A;) + rk K (A i /L l ) = rk fi (A l+ i/L i+1 ) + rk R (L i+1 / L^, 

as both sides are equal to rk^(Aj + i/Lj). We conclude from condition 3.5.1 c) 
that rkfj(Aj/Lj) = ne = rk^(Aj + i/Lj + i). Thus ( 3.8.2| ) amounts to the 



equation rk/j(Aj+i/Ai) = rk R (Li + i/Li), so that the chain (Lj)j is complete. 

From (ti,t-i) iR = we deduce that (£j, Z/_j) C u e i?[[ii]] and hence that 
u- e L-i C L\. 

From u e Aj C Lj on the other hand we deduce u e L^ C A_j. By definition, 



we know that (Lj,-u e LV) c u e i?[u]], which implies {ti,a-i(u e Ly)) i = 0. 
Consequently ct-i(u e LV) C which shows that u e Vf C L-j. Hence also 

This proves the existence of the map a. Its injectivity as well as the 
characterization of its image are immediate. □ 

Note that £ = (Aj,/5j,$j, (•, is a polarized chain of F[it]/ii e -modules of 
type (£). In fact £ = £(S>p[ u jF[u]/u e . Let R be an F-algebra. There is an obvi- 
ous action of Aut(Z)(R[u]/u e ) on M e < n (R), given by ((f>i)-{U) = (<Pi(U))- The 
canonical morphism R{u} — > R[u]/u e induces a morphism Aut(£)(i2[u]) — > 
Aut(£)(i?[u]/-u e ) and we thereby extend this Aut(£)(i?[u]/u e )-action on 
M e ' n (R) to an Aut(£)(F[n])-action. 

Lemma 3.8.3. Let R be an ¥ -algebra and let t G M e ' n (R). We have 
Aut(£)(F[uJ) • t = Aut(£)(i?[u]/u e ) • t. 
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Proof. The map Aut(£)(.R[ii]) — > Aut(C)(R[u]/u e ) is surjective by Proposi- 
tionEZl □ 

Define a subfunctor J Sp = I S p 2ri of L Sp 2n by 7 Sp = L Sp 2n n 7 GSp . 

Lemma 3.8.4. We ftaue J GSp (F) = F[u] x / Sp (F). 

Proof. Let 5 G I G s p (F). Clearly c(g) G F[u] x . As charF / 2, there is an 
x G F[-u] x with x 2 = c(g). Then x~ x g G is P (F). □ 

Lemma 3.8.5. Let g G 7sp(F). Then g restricts to an automorphism gi : 
Aj — > Aj /or eac/i i £ Z. The assignment g 1— )■ (<?j)j defines an isomorphism 
Js p (F)^Aut(£)(FM). 



Proof. Analogous to the proof of Lemma 2.5.9 □ 



Proposition 3.8.6. Let t G M e,n {¥). Then a induces a bijection 

Aut(£)(F[u]/u e ) • t ^ I GSp (F) • a(t). 
Consequently we obtain an embedding 

Aut(£)(F[u]/u e )\M e '"(F) ^ I GSp (F)\J- GSp (F). 

Proof. The composition M e,n (F) -^s p e ^(^) ^- ^~GS P (F) is equivariant for 
the Aut(£)(F[u])-action on M e ' n (F), the J Sp (F) -actio n on .FcsptF) and the 
isomorphism Is P (F) — > Aut(£)(F[u]) of Lemma 



3.8.5 



It therefore induces a 
bijection Aut(£)(F[u]) -t ^> Is p (F) -a(t). We conclude by applying Lemmata 
[3X31 and [3X11 □ 

Consider a' : M e '"(F) ^ J" GSp (F) m '\ L GSp(F)// GSp (F). 
Proposition 3.8.7. Let t G M e,n (¥). Then a' induces a bijection 

Aut(£)(F[«]/u e ) • t ^ / GSp (F) • a'(t). 
Consequently we obtain an embedding 

Aut(£)(F[u]A/)\Af e '"(F) / GSp (F)\GSp(F((n)))// GS p(F). 



Proof. Clear from Proposition 3.8.6| as the isomorphism 4>(¥) is in particular 
I G S p (F)-equivariant. □ 



Let R be an F-algebra and ((fi)i G Aut(£)(-R). The decomposition (3.5.3) 
induces for each i a decomposition of ipi : A^/j — > A^r into the product of 
i?[n]/u e -linear automorphisms (pi )0 - : A^/j — > A-i,R- The following statement 
is then clear (cf. the proof of Proposition 3.5.4). 

Proposition 3.8.8. Let R be an ¥ -algebra. The following map is an iso- 
morphism, functorial in R. 

Aut(£)(l?) -»■ Yl Aut(C)(R[u]/u e ), 
o-es 
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Consider the composition 



a : M loc (F) JJ M e ' n {¥) \\ L GSp(F)// GS p(F). 

o-ee o-ee 

For a G 6 denote by a ff : M loc (F) -> L GSp(F)// GSp (F) the corresponding 
component of a. 

Theorem 3.8.9. Let t G M loc (F). Then a induces a bijection 

Aut(£)(F)-i A J] / GSp (F) • a a {t). 
oee 

Consequently we obtain an embedding 

Aut(£)(F)\M loc (F) ^ 11 I GSp (F)\GSp(F((n)))// GS p(F). 



oee 



u3 5 511 — 

Proof. The isomorphism M loc (F) *-——'> rioee M e,n (F) is equivariant for 
the Aut(£)(F) action on M loc (F), the f[ ae6 Aut(C )(¥[u}/u e ) action on 



floee M e ' n (F) and the isomorphism of Lemma 3.8.8 The statement thus 



follows from Proposition 3.8.7 □ 



3.9. The extended afRne Weyl group. Let T be the maximal torus of 
diagonal matrices in GSp 2n and let N be its normalizer. We denote by 
W = iV(F((u)))/T(F[uJ) the extended affine Weyl group of GSp with respect 
to T. Setting 

W = {w 6 S 2n | Vi G {1, . . . , 2n} : w(i) + w(2n + 1 - i) = 2n + 1} 

and 

A = {(oi, . . . , a 2n ) G Z 2n | ai + a 2 „ = a 2 + a 2n -i = • • • = a n + a n +l}, 

the group homomorphism v :W t< X ^ A(F((u))), («;, A) i— > A w u x induces 
an isomorphism W k A VF. We use it to identify W with W >< A and 
consider W subgroup of GSp(F((u))) via v. 

To avoid any confusion of the product inside W and the canonical action 
of 5 2n on Z 2n , we will always denote the element of W corresponding to 
A G A by u x . 

Recall from [5J §2.5-2.6] the notion of an extended alcove (xj) 2 ™Q 1 for 
GSp 2n . Also recall the standard alcove (wj) 2 ™^ 1 . As ™ l° c - cr ^- we identify 
W with the set of extended alcoves by using the standard alcove as a base 
point. 

Write e = (e^). 



Definition 3.9.1 (Cf. [H], Definition 2.4]). An extended alcove (x^o 1 
called permissible if it satisfies the following conditions for all i G {0, . . . ,2n- 
1}. 

(1) uji < Xi < uJi + e ; where < is to be understood componentwise. 

(2) Y?jLi x i{j) = ne-i. 

Denote by Perm the set of all permissible extended alcoves. 



is 
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Proposition 3.9.2. The inclusion N(¥([u))) C GSp(F((u))) induces a bijec- 
tion W ^ 7 G Sp(F)\GSp(F((u)))//GSp(F). In other words, 

GSp(F((«))) = ]J I G s P (F)x/ GS p(F). 

Under this bijection, the subset 

Aut(C)(¥[u]/u e )\M e ' n (¥) C / G sp(F)\GSp(F((n)))// GS p(F) 



of Proposition 3.8.1 corresponds to the subset Perm C W. 

Proof. The first statement is the well-known Iwahori decomposition. The 
second statement follows easily from the explicit description of the image of 



a in Proposition 3.8.1 □ 



Corollary 3.9.3. Under the identifications of Theorem \3.8.9\ the set 
f| CTg g Perm constitutes a set of representatives of Aut(£)(F)\M loc (F). 

Remark 3.9.4. In the normalization of Corollary \3.9.3\ we have indexed 
the KR stratification by the relative position of C (8) F to its image under 
Verschiebung, compare Remark \2.5.1b] The normalization of Corollary \3.9.3 
therefore differs from the one of Definition \2. 5.1J\ by the automorphism 

ILee Perm -> Uaee Perm > ( x <^) ^ C" 6 ^ 1 )- 



3.10. The p-rank on a KR stratum. Recall from Section 2.3 the scheme 
A/Zp associated with our choice of PEL datum, and the KR stratification 

A(¥) = J] Ax. 

xeAut(£)(F)\M loc (F) 

We have identified the occurring index set with n<re6 P erm m Corollary 



3.9.3. We can then state the following result. 



Theorem 3.10.1. Let x = {x a ) a G J^ggPerm. Write x a = w CT n A<T with 
w a G W, A ff G J. Then the p-rank on A x is constant with value 

9 ■ |{1 < % < 2n | Vo- G e(w a (i) = i A A ff (i) = 0)}|. 

Remark 3.10.2. For F = Q, we recover the result Theoreme 4.1] of 
Ngd and Genestier. 



A 



Proof of Theorem 3.10.1. Let 1 < i < 2n and x G Perm. Write x = wu 
with w G W, A G X. By Propositions 2.4.5 and 2.4.6 it suffices to show the 
following equivalence. 

Ai = x(Ai) + Ai_i 44> (w(i) = i A A(i) = 0). 

Consider the subset S = {u k ej \ k G Z, 1 < j < 2n} of F((u)) 2n . Then 
x induces a permutation of S, namely x(u k ej) = u x ^ +k e w ^y We have 
Aj n S = Aj_x n 5 II {ti _1 ej}, and x G Perm implies x(Aj_i n S) C Aj_i n 5. 
Consequently n _1 ej G x(Aj n S) if and only if x{u~ l e{) = u~ 1 ei, which in 
turn is equivalent to w{i) = i A = 0, as desired. □ 
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3.11. The density of the ordinary locus. Denote by < and t the partial 
order and the length function on W defined in §2.1], respectively. We 
extend < and t to Ilo-ee ^ ^ setting (x a )a < {x' a ) a :44> (Vcr G 6 : x a < x' a ) 
and l({Xa)o) = J2a^( x o-)- 

Lemma 3.11.1. Let x G na-e6^ :>erm - ^ e smo °th ^-variety A x is equidi- 
mensional of dimension £(x) . Furthermore the closure A x of A x in Af is 
given by 

(3.11.2) A x = \\A y . 

y< X 



Proof. As in Remark 2.3.10 there is, etale locally o n Aw, an etale morphism 

we have identified 



3.8.9 



P : Aw -> A4 oc with Ax = /3 _1 (M^ oc ). In Theorem 
M l ° c with the Schubert cell C x C ILe6 GSp 2n (F((u)))/J G s P (F) corresponding 
to x. The statements therefore follow from well-known properties of Schubert 
cells once we know that all KR strata are non-empty. This is true in the 
Siegel case by Genestier's result [31 Proposition 1.3.2], in the case that p is 
unramified in F by the result [H Theorem 2.5.2(1)] of Goren and Kassaei, 
and in the ramified case by a yet to be published result of Yu [32] . □ 

Our next goal is to generalize the result |16l Corollaire 4.3] of Ngo and 
Genestier on the density of the ordinary locus. Denote by A^ 119 ^ C .4(F) the 
subset where the p-rank of the underlying abelian variety is equal to ng. By 
the determinant condition imposed in the definition of A this is precisely the 
ordinary locus in A(¥). 

Corollary 3.11.3. The ordinary locus A^ n9 ^ is dense in A(¥) if and only if 
p is totally ramified in F. 

Proof. Let fx = (e^ 9 \0^ 9 ') G X. Our subset Perm C W is precisely the set 
denoted by Perm(//) in [8]. By [H Theorem 10.1], we have 

(3.11.4) Perm(/i) = Adm(//), 

where Adm^) := {x G W \ 3w G W : x < u w ^}. 

Write Wl = {x £W \3w eW : x = u w ^}. Then fl3.ll.4p implies that 



llo-ee * s precisely the subset of maximal elements for < in_TLre6 Perm. 
Denote by Agjj C Elo-ee ^ ^ ne diagonal. By Theorem 



3.10.1 



we have 



j\{ng) _ Y[ x€ A m A x - The statement therefore follows from ( 3. 11 .2| ) by noting 



that Aot = rio-ee ^ an d om y if P is totally ramified in F. □ 

3.12. An explicit example: Hilbert-Blumenthal modular varieties. 

In this section we use the explicit case of the Hilbert-Blumenthal modular 



varieties to illustrate how Theorem 3.10.1 and the KR stratification in general 



yield results about the geometry of the moduli spaces A. We also compare 
these results to some of those obtained by Stamm in [29] . 

Assume from now on that p is inert in Of, so that we have e = 1 and 
f = g. Assume also that dirnp V = 2, so that n = 1. 

Let us start with a discussion of the index set Ilcree Perm of the KR 



stratification. From Definition 3.9.1| one immediately obtains that the subset 
Perm C W is given by Perm = {u^'°\ u^ ' 1 ', (1, 2)«( 1 ' )}. To put this set 
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into a group theoretic perspective, we recall the setup described in §2.1] 
in this easy special case. Consider the elements r = (1, 2)u^'°\ s\ = (1,2) 
and s = (l,2)n( 1 ~ 1 ) of W. The sub group W a of W generated by sq and s\ 
is a Coxeter group on the generators so and s±, and we denote by < and 
£ the corresponding Bruhat order and length function on W a , respectively. 
Denoting by the cyclic subgroup of W generated by t, we have W = W a x Q. 
The extension of < and £ to W is given by w'r' < w"t" :44> (w' < w" At' = t") 
and £(u/t') := £(w'), f or w', w" G W a and t',t" G fl We extend < and £ to 
rio-ee W as m Section 



3.11 



We see that 

Perm = {sir, s r, r} C W a T. 

The Bruhat order on Perm is determined by the non-trivial relations t < s\T 
and r < sqt, while the length function on Perm is given by £(t) = and 
£{ Si t) = £(s t) = 1. 

in this special case. 



Let us state Theorem 



3.10.1 



and A^ C «4(F) the subsets where the p-rank of the underlying abelian 
variety is equal to and g, respectively. 

Proposition 3.12.1. We have 

A{¥) = #n#. 

The ordinary locus A^ is the union of only two KR strata, namely those 
corresponding to the elements ((sir)w) = (syr, s\T, . . . , sir) and ((sqt)^) = 
{sqt, sqt, . . . , sqt) of rio-ee P erm - The p-rank on all other KR strata is equal 
to 0. 

Lemma 3.12.2. The maximal elements in n CT e6 P erm f or the Bruhat order 
are precisely the elements of length 2 9 in Jlo-ee P erm - ^ e se -t °f these 
maximal elements is given by Yl al =Q{siT, sot}. □ 

From the preceding results, we obtain without any additional work the 
following theorem. 

Theorem 3.12.3. Let g>2. Then 

A® = A {(siT) ( g)) u «4(( S0T )(s)) u .4 (0) . 

Each of Au SlT \( g )y Au SQT \( g )\ and A^ is equidimensional of dimension 2 g , 
and hence so is Ay- 

More precisely, A^ is the union 

A^ ^ — [^J A x 

^(( S ir)W),(( S0 r)W) 

of 2 9 — 2 closed subsets, all equidimensional of dimension 2 9 . 
Furthermore, we have 

A(( SlT )(g)) n -4(( Sor )(9)) C -4 (0) . 

Taking g = 2, we recover [29], Theorem 2 (p. 408)]. Note that for 5 = 2, the 
set A^ ' is precisely the supersingular locus in Ay, because a 2-dimensional 
abelian variety is supersingular if and only if its p-rank is equal to zero. 
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4. The unitary PEL datum 

Let n G N>i. In Sections [5] through [7] we will be concerned with the PEL 
datum consisting of the following objects. 

(1) An imaginary quadratic extension F/Fq of a totally real extension 
F /Q. Let g = [F : Q] and g = [F : Q], so that <? = 2g . 

(2) The non-trivial element * of G&1(F/Fq). 

(3) An n-dimensional F- vector space V. 

(4) The symplectic form (•,•): V x V — >• Q on the underlying Q-vector 
space of V constructed as follows: Fix once and for all a *-skew- 
hermitian form (■,•): V x V — >• -F (i.e. (av,bw)' = ab* (v,w) 
and (v,w)' = —(w,v)* for )),ro £ V, a,i e F). Define (•,•) = 
tr F / Q o (., •)'. 

(5) The element J G End^u (V (8) R) to be defined separately in each 
case, see Sections |5.1[ |6.1| and |7.1[ 

Remark 4.0.4. Denote by GIL. \> the Fo-group given on R-valued points 
by GU (v) /(i?) = {g G GL F ® FoR (V® Fo R) \ 3c = c(g) G R x \/x, y G V ®f R ■ 
(gx,gy)' R = c{x,y)' R \. Then the reductive Q-group G associated with the 
above PEL datum fits into the following cartesian diagram. 

G c ^Res Fo/Q GU (v y 

c c 

G m ,Q C >■ Res Fo /Q G mj F ■ 

5. The ramified unitary case 

5.1. The PEL datum. We start with the PEL datum defined in Section 
[4j We assume that pOf = (Vo) e ° for a single prime Vq of Of and that 
V O F = V 2 for a prime V of O f . Write e = 2e , so that pO F = T e . 
Denote by / = [k-p : ¥ p ] the corresponding inertia degree, so that g = ef 
and go = feo. Fix once and for all uniformizers ttq of Of ® Z( p ) and 7r of 
C F ® ^(p)) satisfying 7r 2 = 7To. We have ir* = —tt. 

For typographical reasons, we denote the ring of integers in F-p by Op and 
the ring of integers in {F )p by Op . Denote by £ = £o P |z p , £o = £ev |z p 
and £' = £o P \o-p the corresponding inverse differents. Then Co = for 
some k G N. The extension Fp / (Fo)p is tamely ramified, so that £' = (vr _1 ). 
The equality £ = (£' • Co then implies that £ = (vr -2 ^" 1 ) and we denote 
by 5 = TT~ 2k ~ 1 the corresponding generator of <£. It satisfies 5* = —5. 
Consequently the form (•, -)q : Vq p x Vq p — >• F-p is *-hermitian and we 
assume that it splits, i.e. that there is a basis (ei, . . . , e n ) of Vq over F-p 
such that (a, e n +i_j)Q = <5<5jj for 1 < i, j < n. 

Let < i < n. We denote by Aj the O-p-lattice in Vq p with basis 

<£i = (7r _1 ei, . . . , 7r _1 ej, ej+i, . . . , e„). 

For k G Z we further define A n fc_|_j = 7r~ fc Aj and we denote by £nfc+i the 
corresponding basis obtained from (Ej. Then £ = (Aj)j is a complete chain of 
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Op-lattices in Vq p . For i G Z, the dual lattice AV := {x G Vq p | (a;, Aj)q p C 
Z p } of Aj is given by A_j. Consequently the chain C is self-dual. 

Let i G Z. We denote by pi : Ai Aj+i the inclusion, by ??i : A n+ j — > Aj 
the isomorphism given by multiplication with ir and by (•,•)■: A, X A_j — )■ Z p 
the restriction of Then (Aj,pi, (•, is a polarized chain of 

Oi^-modules of type (£), which, by abuse of notation, we also denote by C. 

Denote by (•, : Aj x A_j — > Op the restriction of the *-hermitian form 
<5 _1 (•, -)q , and by Hi the matrix describing (•, ■) i with respect to (£j and 
We have 

(5.1.1) Hi = anti-diag((-l) a *-\ . . . , (-l) a *>«) 

for some a^i, . . . ,ai tH G Z/2Z. 

Denote by So the set of all embeddings Fq K and by S the set of all 
embeddings F > C. For each <r G So, we denote by To-,1, G S the two 
embeddings with T a j\ Fo = a. Of course we have r CTi 2 = 7"<t,i *■ 



We obtain isomorphisms 



(5.1.2) 
(5.1.3) 



F 



F< 



IT 



F 9 X I-)- (T a)1 (x),T at2 (x}) a 



of: 



o-eSo 

and C-algebras, respectively. 



The isomorphism (5.1.2) induces a decomposition V 



into C-vector spaces and (-,-)r decomposes into the product of skew- 
hermitian forms (•, •) a : V a x V a — > C, a S So- For each a G So, there are 
TV, So- G N with r CT + So- = n and a basis 03 ff of Vo- over C such that (•, •)' (7 
is described by the matrix D a = diag(^ r<T ), (— i)^^) with respect to Q3<j. 
Denote by J a the endomorphism of described by the matrix D a with 
respect to 25a-. We complete the description of the PEL datum by defining 
J '■= riaeSo J ° G End B0M (1/ ® K). 



5.2. The determinant morphism. The isomorphism (5.1.3) induces a 
decomposition V <8> C = rio-eEo^ 7 ^ i x ^s) C-vector spaces V^.. The 
basis 5B CT of induces bases 5S T<T . of VV CT , over C, and the endomorphism 
J aj C decomposes into the product of endomorphisms J Ta . of V Ta - . We find 
that J T(T 1 is described by the matrix D a with respect to 23 T(T 1 , while J T(T 2 is 
described by the matrix —D a with respect to <B T<T 2 . 

Denote by the (— i)-eigenspace of Jc- From the explicit description 
of the J T(T with respect to the <B T(T . , one concludes that V_j is the Of <8> C- 
module corresponding to the rio-eEo ^ x C-module rio-eEo C Sct x under 
(15X31). 



Let 22' be the Galois closure of F inside C and choose a prime Q' of -E" 
over V. In absolute analogy to ( 5.1.3[ ), we have a decomposition 



(5.2.1) 



E' 



Y[E'x E'. 

o-eSo 



Let M be the Op ® ^'-module corresponding to the n<re£o ^' x -^'-module 



Y\ at =^ (E') ScT x {E'Y" under (5.2.1). From the present discussion we obtain 
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an identification M ®g/ C = V-i of Of ® C- modules. Let OS be a basis of M 
over £" and denote by Mo the Op ® Op/ -module generated by !B. Then Mo 
is an Of ® Opz-stable 0p/-lattice Mo in M. In particular, the morphism 
dety^ : Vo F ®c &c descends to the morphism detjv/ : Vo F ®o E i ~^ &b 



E' 



5.3. The special fiber of the determinant morphism. We write & = 
Gal(kp/¥ p ) = Gal(£/p /F p ). We fix once and for all an embedding lqi : 

Pa' 

kg; ¥ . We consider F as an 0p/-algebra via the composition Of' > 

Uqi <—> F. Also lqi induces an embedding Lp : kp F and thereby an 
identification of the set of all embeddings kp F with 6. Our choice of 
uniformizer it induces a canonical isomorphism 

(5.3.1) O f ®¥ = Y[F[u]/(u e ). 

<tS6 

Proposition 5.3.2. Let x G Of and let {jp a ) a G Ilo-ee FM/(u e ) be ^ he 
element corresponding to x ® 1 under ( [5.3. 1| ) . Then 

X f(x\M ®o e , F) = J] ( T "^(°)) 
o-ee 

m F[T]. 

Proof. Reduce Xe> B / (ar| Afp) modulo Q', using Lemma 



v neo 



3.1.1 



□ 



Denote by E = Q(trc(x ® 1| VL»); x £ F) the reflex field and define 
Q = Q'tlOg. The morphism detyi, is defined over Of- 



5.4. The local model. For the chosen PEL datum, Definition 2.3.1 amounts 
to the following. 

Definition 5.4.1. The local model M loc is the functor on the category of 
OE Q -algebras with M Xoc (R) the set of tuples (tj)iez of Of ® R-submodules 
ti C Ai R satisfying the following conditions for all j 6 Z. 

(a) Pi,n{U) C U+i. 

(b) The quotient Aj^/tj is a finite locally free R-module. 

(c) We have an equality 

det Ai,fl/*i = det v_< ®o E R 

of morphisms Vo f <®r — > A R . 

(d) Under the pairing (•, •)• R : A^jj x A_$ # — )• i?, i/ie submodules ti and 
t-i pair to zero. 

(e) -&i(t n+ i) = U. 

5.5. The special fiber of the local model. For i G Z, denote by Aj 
the free F[n]/u e -module (F[-u]/u e ) n and by (Ej its canonical basis. Consider 
the F-automorphism * : F[u]/u 6 —> ¥[u]/u e , u i— )■ — u. Denote by (•,•); : 
Aj x A_j — )• F[n]/ii e the *-sesquilinear form described by the matrix Hi of 
(5.1.1) with respect to (£j and (£_j. Denote by $j : A n+ j — >• Aj the identity 
morphism. For k G Z and < i < n, let p n fc + j : A n ^ + j — > A n fc + j + i be 
the morphism described by the matrix diag(l^, u, l( n-l_1 )) with respect to 
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Definition 5.5.1. Define a functor M e,n on the category ofF-algebras with 
M e ' n (R) the set of tuples (ij)igz of R[u]/u e -submodules i, C A^r satisfying 
the following conditions for all i EZ. 

( a ) Pi,R(k) c t i+ i L 

(b) The quotient Aj^/ij is finite locally free over R. 

(c) For all p G R[u]/u e , we have 

XR(p\K,R/U) = {T-p(0)) neo 

in R[T]. 

(e) -&i(t n+i ) = ti. 



Let j£Z. Prom (5.3.1) we obtain an isomorphism 



(5.5.2) A iiF = J] A, 



o-ee 

by identifying the basis G^f with the product of the bases (£j. Under this 
identification, the morphism pij decomposes into the morphisms p i: the 
pairing (v)tF decomposes into the pairings (v)j and the morphism i?^ 
decomposes into the morphisms 

Let i? be an F-algebra and let (ii)igz be a tuple of Of £5 i?-submodules 



ti C Ai t R. Then (5.5.2) induces decompositions ti = Y\ ae& into R[u]/u e 



submodules ti jCT C A^/j. The following statement is then clear (cf. the proof 



of Proposition 3.5.4) 



Proposition 5.5.3. The morphism Mp oc — > flo-ee M e,n given on R-valued 
points by 

M^ oc (R) Y[ M e ' n (R), 
(5.5.4) ae& 

(U) ■-> {{U,a)i) a 
is an isomorphism of functors on the category of ¥ -algebras. 

5.6. The affine flag variety. This section deals with the affine flag variety 
for the ramified unitary group. Our discussion is based on and has greatly 
profited from [20], [2]] and |2S], [27]. 

Let R be an F-algebra. Consider the extension i?[u]/i?[uo] with uq = u 2 . 
Also consider the i?((«o))-automorphism * : R((u)) — > R((u)), u \-t —u. Let 

(•,•) be the *-hermitian form on R((u)) n described by the matrix /„ with 
respect to the standard basis of R((u)) n over R((u)). For a lattice A in R((u )) n 

we define A v := {x E R((u)) n \ (x,A) C R\u]}. Recall from Section 3_6 the 
standard lattice chain C = (Aj), in R((u)) n . Note that (Aj) v = A_j for all 
j E Z. We denote by (-, : Aj x A_j — > 12 [it] the restriction of (•, •). It is 



the perfect *-sesquilinear pairing described by the matrix Hi of (5.1.1) with 
respect to (£j and 

In complete analogy with [241 Definition A. 41], we have for an F[uo]- 
algebra R the notion of a polarized chain Ai = (Mi, Qi : Mi — > Mi+\,6i : 
M n+i -»• M h £i : Mi x M_; -> F[ 

u l ®F[u ] °f ®F[u ] -R-modules 
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of type (£) (cf. [Hfl Definition 6.6.1]). The proof of [21 Proposition A.43] 
then carries over without any changes to show the following result. 

Proposition 5.6.1. Let R be an F\uo\-algebra such that the image of uq in 
R is nilpotent. Then any two polarized chains M,N of¥[uJ<S>w uo j R-modules 

of type (£) are isomorphic locally for the etale topology on R. Furthermore 
the functor Isom(.M, Af) is representable by a smooth affine scheme over R. 

Proposition 5.6.2. Let R be an F-algebra and let A4,Af be polarized 
chains o/F[u] <S>f[u ] R\uo\-modules of type (£). Then the canonical map 
lsom.(M,N){R\uo\) — > lsom(M, M)(R{u }/u''q) is surjective for all m G 
N>i. In particular Ai and N are isomorphic locally for the etale topology 
on R. 

Proof. Analogous to the proof of Proposition |3.7.2[ □ 
Denote by U = U n and GU = GU n the F((«o))-groups with 
U(R) = {g£ GL n (K ® Ko R) I g'Lg* = L} 

and 

GXJ(R) = {<? G GL n (K ® Ko R)\3c = c(g) G R x : g'Lg* = c/ n } . 

Definition 5.6.3 ([261 §4.2], [271 §6.2]). Let R be an F-algebra and let (£*), 
be a lattice chain in R((u)) n . 

(1) Let r G Z. The chain (£j)i is called r-self-dual if 

Vi G Z : V( = UqL^{. 

(r) (r) 

Denote by J 7 ^ the functor on the category of ¥ -algebras with J 7 ^ (R) 
the set of r-self-dual lattice chains in R((u)) n . 

(2) The chain is called self-dual if Zariski locally on R there is an 
a G R((uo)) x such that 



(5.6.4) Vi G Z : £ 4 V = aL- 



Denote by J 7 q\j the functor on the category ofF-algebras with LFq\](R) 
the set of self- dual lattice chains in R((u)) n . 

Note that £ G 7§\R). 

Remark 5.6.5. Let R be a reduced F-algebra such that SpecR is connected. 
Then 

T GV (R) = {j4 r) (R). 



Proof. This follows directly from Lemma 3.7. 5[ □ 



Remark 5.6.6. Let R be an F-algebra and let (Lj)j G J-^j \r). For i G Z 
denote by : Lj — > Li+\ the inclusion, by 8{ : L n+ i — > Li the isomorphism 
given by multiplication with u and by E\ : L{ x £_j — > RfuJ the restriction of 
(•,•). Then (Li, Qi,6i,£i) is a polarized chain o/F[it] <8>fi-u ] R\uo\-modules 
of type (£). 



KOTTWITZ-RAPOPORT AND p-RANK STRATA 



37 



Note that for an F-algebra R, the canonical maps 

®fm # (M) -> «((«)) 

are isomorphisms. Consequently we can consider L Mo GU and L Uo U as 
subfunctors of L u GL n . Recall from Remark |3.6.10 the subfunctor I C L GL n . 
We define a subfunctor Jqu of L Uo GU by Iqu 



L U0 GU n /. 



Proposition 5.6.7. The natural action o/L u GL n on T (cf. Remark 3.6.10) 
restricts to an action ofL Uo GU on J^gu- Consequently we obtain an injective 
map 

L uo GV(R)/I GV (R)^ h '' 
9 

for each F-algebra R. The morphism <fi identifies Fq\j with both the etale 
and the fpqc sheafification of the presheaf L Uo GU/Iqu- 

Proof. Let R be an F-algebra. We claim that every a G R((uo)) x lies in the 
image of the map c : GU(i?((«o))) — > R((uo)) x etale locally on R. Assuming 



this, one can proceed exactly as in the proof of Proposition |3.7.8 

To prove the claim, first note that fo r b G R((u 
GU(i?((uo))) satisfies c(bl n ) = bb*. Lemma 
on R, the element a is of the form a = Uq 
v G ii[uo] x and a nilpotent element n G R((uq 



3.7.5 



G R((u)), the matrix bl n G 
implies that Zariski locally 
Uqv(1 + n) for some k G Z, a unit 
Consequently it suffices to 



show that each of Uq,v and 1 + n is of the form bb* for some b G R((u)) etale 
locally on i?. 

As 2 G R x , one easily sees that f is a square in i?[uo] x whenever v(0) is 
a square in R x , which is the case etale locally on R. For 6 = v 7- lu k , one 
has 66* = Uq. Finally, 1 + n is a square in i?((uo)) x ; this follows from the 
Taylor expansion of yT+~x if one notes that (^ 2 ) G Z[^] for all / G N. □ 

5.7. Embedding the local model into the affine flag variety. Let R 

be an F-algebra. We consider an R[u]/u e -module as an it! [u] -module via the 
canonical projection RjuJ — > R[u]/u e . For i £ Z denote by on : Ai — > A^r 
the morphism described by the identity matrix with respect to and (Ej. 
It induces an isomorphism Aj/u e Aj ^> Aj#. Clearly the following diagrams 
commute. 



A; 



Ai+i 



Aj,.R *■ 



(v> 4 



i? 



Aj x A_ 
Aj,R x A_ i)i? — £ i?[u]/u e 



A; 



A n +i 
ot n +i 



Ai p < A. 



The following proposition allows us to consider M e,n as a subfunctor of 



r 



(-eo) 
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Proposition 5.7.1 ([21, §3.3], J2S §4.4-5.1], [23 §6.4-7.1]). There is an 
embedding a : M e ' n <—>>■ given on R-valued by 

M e ' n (R) -> j£~ eo) (i?), 

-> K rl (*i))i- 

/it induces a bisection from M e,n (R) onto the set of those (Lj)j G J 7 ^ £ °\r) 
satisfying the following conditions for all i G Z. 

(i; n e Aj CL.C Aj. 

('Sj For aZZ p G R[u]/u e , we have 

XR(p\~K/L l ) = (T-p{Q)T^ 

in R[T]. Here Aj/L, is considered as an R[u]/u e -module using (1). 



Proof. Identical to the proof of Proposition 3.8.1 □ 



Note that £ = (Ai,p i , (-, AJ^ is a polarized chain of F[ii]® F [ U() ]F[uo]/tto°- 
modules of type (£). In fact £ = £ <S>f[« ] ^[^o]/^ - Let ^ ' 3e an F-algebra. 
There is an obvious action of Aut(£)(/?[uo]/uQ°) on M e ' n (R), given by 
(<Pi) • (ti) = ((pi(ti)). The canonical morphism /?[uo] — > R[uq]/uq° induces a 
morphism Aut(£)(/?[uoJ) — > Aut(£)(/2[uo]/uQ°) and we thereby extend this 
Aut(£)(/?[«o]/^o°)-action on M e ' n (R) to an Aut(£)(i?[u ])-action. 

Lemma 5.7.2. Let R be an F-algebra and let t G M e,n (R). We have 
Aut(£)(i?[it l) • t = Aut(Z)(J2[t*o]/tig) • t. 

Proof. The map Aut(£)(/2[no]) — > Aut(£)(/2[uo]/«o°) ^ s surjective by Propo- 
sition □ 

Define a subfunctor /u of L UQ U by /tj = L„ U n /gu- 

Lemma 5.7.3. We have / G u(F) = F[u l x /u(F). 



Proof. Analogous to the proof of Lemma 3.8.4, noting that for g G / G u(F) 
one has c(g) G F[uo] x . □ 

Lemma 5.7.4. /ei 5 G /tj(F). T/ien restricts to an automorphism gi : 
Aj — )• Aj for each i G Z. T/ie assignment g 1— > (oj)i defines an isomorphism 
/u(F)^Aut(£)(FM). 



Proof. Analogous to the proof of Lemma 2.5.9 □ 



Proposition 5.7.5. Zei f G M e ' n (F). /Tien a induces a bisection 

Aut(£)(FM/u*°) • t ^ / GU (F) • a(t). 
Consequently we obtain an embedding 

Aut(£)(F[u ]/u^)\M e > n (F) ^ / GU (F)\.F GU (F). 
Proof. Analogous to the proof of Proposition |3.8.6[ □ 

Consider a' : M e < n {F) Jgu(F) L uo GU(F)// GU (F). 
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Proposition 5.7.6. Let t S M e,n {¥). Then a' induces a bijection 

Ant(C)(¥[u }/u e °) • t ^ J GU (F) ■ a'(t). 
Consequently we obtain an embedding 

Aut(£)(F[u ]/u^)\Af e >"(F) ^ 7 GU (F)\GU(F((«o)))// GU (F). 



Proof. Clear from Proposition 5.7,5| as the isomorphism 0(F) is in particular 
Iqu (F) -equi variant . □ 



Let R be an F-algebra and (<fi)i G Aut(£)(i?). The decomposition (5.5.2) 
induces for each i a decomposition of ipi : Aj^ — > A^jj into the product of 
-R[u]/u e -linear automorphisms </?j )(T : K^r — > Aj^. The following statement 
is then clear (cf. the proof of Proposition 3.5.4). 

Proposition 5.7.7. Let R be an F-algebra. The following map is an iso- 
morphism, functorial in R. 

Aut(£)( J R) -> \\ Aut(C)(R[u }/u e Q °), 
o-ee 

(<Pi)i ^ ({ < Pi,a)i)ae6- 

Consider the composition 



a : M loc (F) JJ M e >"(F) JJ L U0 GU(F)// GU (F). 

oee o-ee 

For (j £ 6 denote by a a : M loc (F) -> L Uo GU(F)/J GU (F) the corresponding 
component of a. 

Theorem 5.7.8. Let t 6 M loc (F). T/ien a induces a bijection 

Aut(£)(F)-t^> J] J GU (F) • a a (t). 
o-ee 

Consequently we obtain an embedding 

Aut(£)(F)\M loc (F) J] / GU (F)\GU(F((n )))// GU (F). 

o-ee 



Proof. Identical to the proof of Theorem 3.8.9 □ 



5.8. The extended affine Weyl group. As in [HI 3.2], [271 3.2], we denote 
by S the standard diagonal maximal split torus in GU. Denote by T the 
centralizer and by N the normalizer of S in GU. By the discussion in |26| 
3.4], |27| 5.4], the Kottwitz homomorphism for T is given by 

k t : T(F((u ))) -> Z n , diag(xi, . . . ,x n ) (-)■ (val u (xi), . . . ,val lt (x n )). 

Consequently the kernel T(F((n ))) 1 of k t is equal to T(F((u ))) n D n (¥[uj), 
with the intersection taking place in GL n (F ((«))). Here D n C GL n denotes 
the subgroup of diagonal matrices. By definition, the extended affine Weyl 
group of GU with respect to S is given by W := A(F((u )))/T(F((u )))i. 
Set 

W = {w e S n | Vi e {1, . . . , n} : w(i) + w(n + 1 - i) = n + 1} 
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and 

X = {(xi, . . . ,x n ) eZ n \3r e TNi G {1, . . . ,n} : Xi + x n+ i-i = 2r}. 

We identify W with a subgroup of U(F((uo))) via W 3 w t- > A w . One easily 
sees that N(¥((u ))) = W ix T(F((u ))). The Kottwitz homomorphism k t 
induces an isomorphism T(¥((uq)))/T(¥((uo)))i — > X and we thereby identify 
W with W tx X. _ 

To avoid any confusion of the product inside W and the canonical action 
of S n on Z n , we will always denote the element of W corresponding to A G X 
by u x . 

Recall from §2.5] the notion of an extended alcove (xi)™~Q for GL n . An 
extended alcove for GU is an extended alcove (xi)2Z Q for GL n such that 

3r E ZVi € {0, . . . , n}Vj G {1, . . . , n] : Xi {j) + x n -i(n + 1 - j) = 2r - 1. 

Here x n = x + (l (n) ). 

Also recall the standard alcove (uii)?Z ■ As in the linear case treated in 

loc. cit., we identify W with the set of extended alcoves for GU by using the 
standard alcove as a base point. 
Write e = (e^). 

Definition 5.8.1 (Cf. p3|). An extended alcove (xj)™^ 1 for GU is called 
permissible if it satisfies the following conditions for all i G {0, . . . , n — 1}. 

(1) < Xi < UJi + e, where < is to be understood componentwise. 

(2) Ylj=i x i{j) = ne -i. 

Denote by Perm the set of all permissible extended alcoves for GU. 

Proposition 5.8.2. The inclusion iV(F((uo))) C GU(F((uo))) induces a bi- 
jection W ^ J gu (F)\GU(F((u )))//gu(F). In other words, 

GU(F((n ))) = ]J / GU (F)x/ GU (F). 

xew 

Under this bijection, the subset 

Aut(£)(F[u ]/^°)\M e >"(F) C / gu (F)\GU(F((«o)))//gu(F) 



of Proposition 5.7.6 corresponds to the subset Perm C W. 

Proof. The first statement is discussed in [26J, 4.4], [271 6.4]. The second 
statement follows easily from the explicit description of the image of a in 
Proposition |5.7.1[ □ 



Corollary 5.8.3. Under the identifications of Theorem \5. 7.8\ the set 
n<7e6 P erm constitutes a set of representatives of Aut(£)(F)\M loc (F). 

Remark 5.8.4. As explained in Remark \3.9.4\ the normalization of Corol- 
lary \5.8.3\ differs from the one of Definition \2.5.14 by the automorphism 

ILee Perm -> ILee Perm > ( x °) ^ (u^* 1 ) 
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5.9. The p-rank on a KR stratum. Recall from Section 2.3 the scheme 



A/Oeq associated with our choice of PEL datum, and the KR stratification 

A{¥) = \\ A x . 

xeAut(£)(F)\Af 1 ° c (F) 

We have identified the occurring index set with flcree P erm m Corollary 



5.8.3 . We can then state the following result. 



Theorem 5.9.1. Let x = (xo-)o- G H^ggPerm. Write x a = w a u Xa with 
w a S W, Ac- € X . Then the p-rank on A x is constant with value 

g • |{1 < i < n | Vct G &{w a {i) = i A X a (i) = 0)}|. 

Proof. The proof is identical to the one of Theorem |3.10.1| □ 

6. The inert unitary case 

6.1. The PEL datum. We start with the PEL datum defined in Section 
[4j We assume that pOp Q = (Vo) e for a single prime Vq of Of and that 
VqOf = V for a single prime V of Op. Denote by fo = [k-p : F p ] and 
/ = [k-p : Fp] the corresponding inertia degrees, so that / = 2/q. We fix once 
and for all a uniformizer it of Of ® <^(p)- Then tt is also a uniformizer of 

Denote by £ = £o p |z p the corresponding inverse different. Choose a 
generator 5 of £ satisfying 5* = —5. Consequently the form (v)q : 
Vq p x Vq p —t- Fp is *-hermitian and we assume that it splits, i.e. that there 
is a basis (ei,...,e n ) of Vq p over such that (e*, e n +i_j)Q = <Wjj for 
1 < j < n. 

Let < i < n. We denote by A, the 0^ -lattice in Vq p with basis 
<Bi = (7r _1 ei, . . . , 7r _1 ej, e i+1 , . . . , e n ). 

For fceZwe further define A ra fc + j = 7r _fc Aj and we denote by £nfc+i the 
corresponding basis obtained from (£j. Then £ = (Aj), is a complete chain of 
Of v -lattices in Vq p . For ieZ, the dual lattice := {x G Vq p | (x, A$)q C 
Z p } of Aj is given by A_j. Consequently the chain £ is self-dual. 

Let ieZ. We denote by : Aj — > Aj + i the inclusion, by $i : A„, + j — >• Aj 
the isomorphism given by multiplication with it and by (•, ■) i : Aj x A_j — > 7L V 
the restriction of (t)q p - Then (Aj, pi, i9j, (•, -)j)j is a polarized chain of 
-modules of type (£), which, by abuse of notation, we also denote by 

£ £inert 

Denote by (•, ■) i : Aj x A_j — > Of v the restriction of the *-hermitian form 
<5 _1 (•, -)q . It is the *-sesquilinear form described by the matrix /„ with 
respect to (£j and <£_j. 

Denote by So the set of all embeddings Fq K and by £ the set of all 
embeddings F ^ C. Also write & = Gal{k-p/¥ p ) and So = Gal(A;-p /Fp). 

Let E' be the Galois closure of F inside C and choose a prime Q' of E' over 



V . Consider the maps 7 : £ — > & and 70 : Xq — > &o of Lemma 3.1.1. For 



each a G 60 we denote by To-j, 7^2 € <5 the two elements with T CT j| fc ^ = <7. 
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Let (J G So and j E {1,2}. There is a unique t^j G S with To-j]^ = a 
satisfying 

(6.1.1) 7(^j) = 7- 70 (<t)j. 

Exactly as in Section [5j we define for each a £ So integers r a , s a with 
T a + s<t = and using these the element J 6 Ends®R(y <8> M). Denote by 
V-i the (— i)-eigenspace of Jc- As before, we construct an Of <g) O^'-module 
Mq which is finite locally free over Oe', such that Mo ®o , C = as 
Of ® C- modules. 

6.2. The special fiber of the determinant morphism. Let a G ©o- We 

define 

r a = ^2 r a i and s a = ^ s a >. 
a'e 7o - 1 (<7) cr'e7 _1 W 
As the fibers of 70 have cardinality e, it follows that r a + ~s a = ne. 

We fix once and for all an embedding lqi : kqi M- F. We consider F as an 

Pq' 'S' 

C?£/-algebra with respect to the composition Oe 1 > kg; F. Also lqi 

induces an embedding up : fcp <—t F and thereby an identification of the set 
of all embeddings k-p '—>¥ with (3. 

Our choice of uniformizer tt induces a canonical isomorphism 

(6.2.1) F ®F = []F[M]/(ii c )xF[u]/(ti e ). 

Here in the component F[u]/(u e ) x F[u]/(n e ) corresponding to a G Go, the 
first factor is supposed to correspond to T a ,i and the second factor is supposed 
to correspond to T a> 2- 

Proposition 6.2.2. Let x G O f and let ((q Ta ^, #7^2)) CT G Il^eSo F M/( n6 ) x 
F[u]/(u e ) be the element corresponding to x g) 1 under ( |6.2.1[ ). T/ien 

Xf(x|M ® Oj5 ,F)= J] (T- 9tCTi1 (0)) 5ct (T- g TCT , 2 (0)f CT 

in F[T]. 



Proof. Reduce xe> , (x|Mq) modulo Q', using (6.1.1). □ 



Denote by E = Q(trc(x ® 1| VL»); x £ F) the reflex field and define 
Q = Q! C\Oe- The morphism detyi, is defined over Oe- 



6.3. The local model. For the chosen PEL datum, Definition 2.3.1 amounts 
to the following. 

Definition 6.3.1. The local model M loc = M loc ' inert is the functor on the 
category of Oe q - algebras with M loc (i?) the set of tuples (U)i^z of Of <8> R- 
submodules U C Aj^, satisfying the following conditions for all i £ Z. 

(a) Pi,n{ti) C t i+1 . 

(b) The quotient Aj^/t, is a finite locally free R-module. 

(c) We have an equality 

det Ai.it/tj = dety_ i ®o E R 
of morphisms Vq f ®r — > A}j. 
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(d) Under the pairing (•, -) i R : A^ij x A_j r —> R, the submodules ti and 

pair to zero. 

(e) -&i(t n+ i) = U. 

6.4. The special fiber of the local model. For i £ Z, denote by Aj the 
free F[u]/ii e -module (¥[u]/u e ) n and by (Ej its canonical basis. Denote by 
"&i : A n+ j —7- Aj the identity morphism. Consider the map * : F[u]/ii e x 
¥[u]/u e -»■ ¥[u]/u e x ¥[u]/u e , (a,b) \-> (b,a). Let A;,i and A i>2 be two 
copies of Aj and denote by (-,•)» i : x A_j j2 — > ¥[u]/u e (resp. (•,•)$ 2 : 
Aj ; 2 x A_j i — > F[ii]/u e ) the perfect bilinear map described by the matrix J n 
with respect to (S^i and (£_i,2 (resp. (£^2 and £-j,i). Consider the pairing 



(•,•). : (A^ x A ij2 ) x (A_i,i x A_j, 2 ) -> FM/« e x F[u]/u e , 

((a?i,a?a)i (l/i,!/2)) ^ ((si>lte}i,i , (^2, 2/l)i, 2 ) • 
It is a perfect *-sesquilinear pairing. 

For k G Z and < i < re, let p n fc + j : ^. n k+i — > A n fc + j + i be the morphism 
described by the matrix diag(l^, u, l( n ~* -1 )) with respect to <£ n k+i and 
^nfc+i+l- 

Definition 6.4.1. Let r, s G N loii/i r + s = ne. Define a functor M e ' n ' r on 
the category of¥-algebras with M e ' n,r (R) the set of tuples (ti)igz of R[u]/u e - 
submodules ti C Aj^ satisfying the following conditions for all i G Z. 

(V Pz,fl(*i) C tj.+i^ 

f&) The quotient Aj^/tj is a finite locally free R-module. 

(c) For all p G R[u]/u e , we have 

xdpWR/U) = {T-p(0)) s 

in R[T). 

(d) $i(t n+ i) = U. 



Let i G Z. From (6.2.1) we obtain an isomorphism 
(6.4.2) Aj, F = J| Aj,i x Aj, 2 

creSo 

by identifying the basis (Ejf with the product of the bases (£j. Under this 
identification, the morphism p^-p decomposes into the morphisms ~p i} the 
pairing (-,-) iF decomposes into the pairings and the morphism 1?^ 

decomposes into the morphisms $j. 

Let R be an F-algebra and let (ij)jez be a tuple of Of ® i?-submodules 
tj, C Aj^R. Then (6.4.2) induces decompositions ti = Y\ ae6o t-i,T a 1 x U,r a2 
i?[it]/u e -submodules tj^ a . C h- i.j.R- The following statement is then clear (cf. 
the proof of Proposition 3.5.4). 

Proposition 6.4.3. The morphism $1 : Mp oc — > n<reSo M e,n,r,T given on 
R-valued points by 

Ml oc (R) -»• [J M e ' n ^(R), 
o-ee 

(ti) i-> ((*i,T,,i)0<r 
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is an isomorphism of functors on the category ofF-algebras. 

Remark 6.4.4. For symmetry reasons, also the morphism <&2 : M^ c — > 
rio-eGo M e ' n,Scr given on R-valued points by 

Ml oc (R) -> Yl M e > n ~ s «(R), 
o-e6 

(U) ^ ((ti,Ta,a)<) ff 

is an isomorphism of functors on the category of ¥ -algebras. 

The morphism n CT e6o M e ' n ' r ' 7 — > Y\ a& Q M e ' n,SrT making commutative the 
diagram 



M loc 




o-eSo 



J^e,n,r a 



a-e&o 



M e 



is given by on R-valued points by 

Y[ M e ' n '^{R)^ Yl M e ' n ^{R), 

<re6o ctS6o 



(6.4.5) 



6.5. Embedding the local model into the affine flag variety. Recall 
from Section |3.6| the affine flag variety J- . Let R be an F-algebra. We 
consider an i?[n]/n e -module as an i?Ju[ -module via the canonical projection 
R{uj — > R[u]/u e . For i 6 Z, denote by 04 : Aj — > Aj^ the morphism 
described by the identity matrix with respect to and £j. It induces an 
isomorphism Aj/n e Aj — )• A^jj. Clearly the following diagrams commute. 



A; 



c A i+ i 



A,- 



A. 



««+. 



— #i,R — 

Aj R < — — A n+ j n. 



Let r, s £ N with r + s = ne. The following proposition allows us to consider 
subfunctor of J 7 . 

Proposition 6.5.1 ([19, §4]). There is an embedding a : M e ' n ' r <^-> J 7 given 
on R-valued points by 

M e ' n ' r (R) T(R), 

(ti)i -> K^feDi. 

It induces a bijection from M e ' n ' r (R) onto the set of those (Lj)j E J~(R) 
satisfying the following conditions for all i € Z. 

(X) n e Ai CL.C A<. 
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(2) For all p G R[u]/u e , we have 

XR(p\A i /L i ) = (T-p(0)) s 
in R[T]. Here Aj/Lj is considered as an R[u] / u e -module using (1). 



Proof. Analogous to the proof of Proposition 3.8.1 



□ 



Let R be an F-algebra. Denote by (-, •) : R((u)) n x R((u)) n -»■ R((u)) the 
bilinear form described by the matrix I n with respect to the standard basis of 
R((u)) n over R((u)). Further denote by (•, •) i : Aj x A_j — > RfuJ the restriction 
of (•,•). Note that the diagram 



A,- x A_ 



(v> 4 



R{u 



4 i (v)»,i,-R n , 

Aj i p x A_j o r > R\u 



/u e 



commutes. For a lattice A in R((u)) n we define A v := {x G R((u)) n \ (x,A) C 
Rfuj}. 



As in Remark 6.5.11 , the morphism ^ : M e,n ' T — > M e,n,s given on ii-valued 
points by 

M e ' n ' r (R) -> M e ' n ' s (R), 

is an isomorphism. 

Proposition 6.5.2. The following diagram commutes. 



M e ' n ' r C 
* 



T 



(i,).^(« e i!,), 



- T . 

Proof. Similar to the proof of the duality statement in the proof of Proposition 

□ 

Note that C = (Aj, p i} $j) is a chain of ¥[u]/u e -modules of type (£). In fact 
C = C ¥[u]/u e . Let R be an F-algebra. There is an obvious action of 
Aut(C)(R[u]/u e ) on M e ' n ' r (R), given by (^) • {U) = The canonical 

morphism R[u] — > R[u]/u e induces a map Aut(£)(i2|«J) — > Aut(C)(R[u]/u e ) 
and we thereby extend this Aut(£)(i?[ti]/it e )-action on M e,n ' r (R) to an 
Aut(£)(i?M)-action. 

Lemma 6.5.3. Let R be an ¥ -algebra and let t G M e,n,r (R). We have 
Aut(£)(i?H) • t = Aut(l){R[u}/u e ) ■ t. 

Proof. The map Aut(£)(i?[itJ) — > Aut (C)(R[u]/u e ) is surjective by Proposi- 
tionESSI □ 
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Lemma 6.5.4. Let g G /(F). T/ien 5 restricts to an automorphism gi : 
Aj — )• Aj /or eac/i i € Z. T/ie assignment g h-> (gi)i defines an isomorphism 
J(F)^Aut(£)(FM). 



Proof. Clear (cf. the proof of Lemma 2.5.9). □ 
Proposition 6.5.5. /e£ f G M e,n ' r (F). /Tien a induces a bijection 

Aut(£)(F[u]/n e ) • t ^ /(F) • a(t). 
Consequently we obtain an embedding 

Aut(£)(F[u]/u e )\A/ e ' n ' r '(F) ^ J(F)\.F(F). 
Proof. Analogous to the proof of Proposition |3.8.7[ □ 

Consider a' : M e < n ' r (¥) ^ T(W) m \ LGL n (F)/J(F). 
Proposition 6.5.6. Let t G M e ' n ' r (F). Then a' induces a bijection 

Aut(£)(FM/n e ) • t ^ /(F) • a'(t). 
Consequently we obtain an embedding 

(6.5.7) Aut(£)(FM/u e )\M e >"> r (F) ^ /(F)\GL n (F((n)))//(F). 



Proof. Clear from Proposition 6,5.5| as the isomorphism 4>(¥) is in particular 



/(F)-equivariant. □ 

Denote by r the adjoint involution for (•, •) on GL n (F((u))), so that for 
g G GL„(F ((«))) we have (gx,y) = {x,g T ), x,y G F((u)) n . 

Proposition 6.5.8. The vertical maps in the following diagram are well- 
defined bisections and the diagram commutes. 

Aut(£)(F[u]/u e )\M e <"' r (F) clHL /(F)\GL n (F((n)))//(F) 

sh^OT)- 1 

Aut(£)(F[u]/n e )\M e ' n ' s (F) ^3 /(F)\GL n (F((u)))//(F). 

Proof. In view of Proposition |6. 5 . 2] it suffices to note the following statement, 
which follows from a short computation: Let A be a lattice in F((u)) n and let 
g G GL n (F ((«))). Then (gAf = (f^W- □ 

Let R be an F-algebra and 92 = {tpi)i G Aut (£)(/?). The decomposition 



(6.4.2) induces for each i a decomposition of <pi : Am — > Ai R into the 



product of i?[-u]/u e -linear automorphisms ifi,T aj '■ ^-i,j,R — ► ^-i,j,R- The 



following statement is then clear (cf. the proof of Proposition 3.5.4). 



Proposition 6.5.9. Let R be an IF '-algebra. The following map is an iso- 
morphism, functorial in R. 

Aut(£)(i?) -> Yl Aut(C)(R[u]/u e ), 
0-660 
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Consider the composition 

a x : M loc (F) % \\ M e ' n ^{¥) 



- \{ LGL n (F)//(F) 



For a G 6 denote by a 1(0 . : Af loc (F) -> LGL n (F)/J(F) the corresponding 
component of ol\. 

Theorem 6.5.10. Let t G M loc (F). Then a.\ induces a bijection 
Aut(£)(F)-t ^> J] W'^W' 

trSSo 

Consequently we obtain an embedding 

, i: Aut(£)(F)\M loc (F)^ [] /(F)\GL n (F(( u )))//(F). 

o-e6o 



Proof. Identical to the proof of Theorem 3.8.9 



□ 



Remark 6.5.11. In the same way, the composition 



a 2 : M loc (F) % ] [ M' 



(F) 



> [] LGL n (F)//(F) 
o-eSo 



induces an embedding 

l 2 : Aut(£)(F)\M loc (F) ^ /(F)\GL n (F((«)))/I(F) 

o-e6 



i?y Proposition 6.5.8 the following diagram commutes. 

w ae&0 m\GUM(n)))/m 



Aut(£)(F)\M loc (F) 



(g CT ) CT ^(«%J)-i) 



n CTe6o ^( F )\GL„(F((n)))//(F) 

6.6. The extended affine Weyl group. Let T be the maximal torus 
of diagonal matrices in GL n and let N be its normalizer. We denote by 
W = N{¥({u)))/T{¥\u\) the extended affine Weyl group of GL„ with respect 
to T. Setting W = S n and X = Z n , the group homomorphism v : W X X — > 
N(¥((u))), (w, A) i y A w u x induces an isomorphism W k X — > W. We use it 
to identify W with W ix X and consider W as a subgroup of GL n (F ((«))) via 

v. 

To avoid any confusion of the product inside W and the canonical action 
of S n on Z n , we will always denote the element of W corresponding to A G X 
by u x . 

Recall from [5, §2.5] the notion of an extended alcove (xi)™^ for GL n . 
Also recall the standard alcove As in loc. cit. we identify W with the 

set of extended alcoves by using the standard alcove as a base point. 

Let r, s G N with r + s = ne and write e = (eW). 
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Definition 6.6.1 (Cf. [H], [5j Definition 2.4]). An extended alcove (xi)^ 
is called r-permissible if it satisfies the following conditions for all i G 
{0,...,n-l}. 

(1) < Xi < UJi + e, where < is to be understood componentwise. 

(2) £i=i*«C?) = «-<. 

Denote by Perm r the set of all r-permissible extended alcoves. 

Proposition 6.6.2. The inclusion N(¥((u))) C GL n (F((u))) induces a bijec- 
tion W ^ I(¥)\GL n (¥((u)))/I(¥). In other words, 

GL n (F((«))) = ]J I(¥)xl(¥). 



Under this bijection, the subset 
Aut(C)(¥[u]/u e )\M e 



(F) C /(F)\GL„(F((u)))//(F) 



of (6.5.7) corresponds to the subset Perm r C W. 

Proof. The first statement is the well-known Iwahori decomposition. The 
second statement follows easily from the explicit description of the image of 
a in Proposition 6.5.1 □ 



Corollary 6.6.3. With respect to the embedding l\ of Theorem \6.5.10\ the 
se t Y\aee P erm f<r constitutes a set of representatives of Aut(£) (F)\M loc (F) . 

The following lemma will be used below. 

Lemma 6.6.4. Let x G W. Write x = wu x with w G W, A 6 X . Define 
w' £W and X' £ X by 

w'(i) = n + 1 — w(n + 1 — i), 1 < i < n 

and 

\'(i) = e _A(n + l-i), 1 < i < n. 
Let x' = w'u x ' . Then x' = u e (x T )~ 1 . 

Proof. This is an easy computation. □ 



6.7. The p-rank on a KR stratum. Recall from Section 2.3 the scheme 
A/Oeq associated with our choice of PEL datum, and the KR stratification 

A(¥) = ]J Ax. 

xGAut(£)(F)\A/ 1 ° c (F) 

We have identified the occurring index set with Ho-eeo P erm ?v in Corollary 



6.6.3 We can then state the following result. 



with 



Theorem 6.7.1. Let x = (s ff ) ff G Flo-eeo P erm ?v- Write x 
w a G W, A CT G X and define elements w' a G W and \' a G X as in Lemma 



6.6.4 ■ Then the p-rank on A x is constant with value 

w a {i) = w' a (i) = i t\ 



9 ■ 



1 < i < n 



Ma G & 







\ a (i) = \> a (i) = 0) 

Proof. Follows from Proposition 6.5.8 and Lemma [6.6.4 by the arguments of 



the proof of Theorem 3.10.1 



□ 
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7. The split unitary case 

7.1. The PEL datum. We start with the PEL datum defined in Section 
[4j We assume that pOf = (Vo) e for a single prime Vq of Of and that 
VqOf = V+V- for two distinct primes V± of Op. Consequently V- = (P+)*. 
Denote by fo = [kp : ¥ p ] the corresponding inertia degree. We fix once and 
for all a uniformizer ttq of Of <%> Z( p ). 

For typographical reasons, we denote the ring of integers in (Fq)p by O-p . 
The inclusion Of Of induces identifications 

Of®% p = O vo x Vq , 
(7 ' L1) F®Q p = (F ) Vo x(F ) Vo . 

Here the first (resp. second) factor is always supposed to correspond to V+ 
(resp. V-). Under ( 7.1. 1| ), the base-change F Q p — > F ® Q p of * takes the 



simple form {F )v X Cgb)gb -> (^b)p x C^oW i a > b ) ^ 0> a )- 

The identification ( 7.1.1| ) further induces a decomposition V vy vp 



V" + x V 7 ! into (Fo)-p -vector spaces V±. The pairing (-,-)q p decomposes 
into its restrictions (•, -)± : V± x T/ T — ^ (Fo)-p . Both (•,•)+ anci (v)- 
are perfect (i 7 o)-p -bilinear pairings and they are related by the equation 
(v, w) + = — (w, v)_ , v G V+, w G VI. 

Denote by Co = ^o-p \z p the corresponding inverse different and fix a 
generator 5o of Co- We fix bases (ei,±, . . . , e ni ±) of V± over (-Fo)'Po such that 
(ei )+ ,en+i-j,-) + = 5 5ij for 1 < i, j < n. 

Let < i < n. We denote by A$± the Op -lattice in V± with basis 

(7.1.2) <£i t ± = (7r _1 ei i ±, . . . ) Jr ""ei,±,e j+ i i ±, . . . ,e n ,±). 

For fc G Z we further define A n fc + j i= |- = 71^ ^A^ and we denote by <£ n fc+i,± 
the corresponding basis obtained from (8j ±. Then = (Aj ±)j is a complete 
chain of Op -lattices in V±. 

Let i G Z. We denote by p^^ : A^-t — >■ Aj+^-t the inclusion and by 
i?i i= i- : A^+j -j- — > A{ ± the isomorphism given by multiplication with ttq. Then 
(A»,±! /?i,±> $i,±) is a chain of Op -modules of type (£±) which, by abuse of 
notation, we also denote by C±. 

For G Z x Z we define A^j) := A^-f x A^-. Then A/jj) is an Ci?(8>Z p - 
lattice in Vq p . A basis of Auj\ over 0f®Z p is given by the diagonal in 
(Ei ( 4. x _ . Then £ = (AjjVjj) is a complete multichain of 0F<8>Z p -lattices in 
Vq p . For G Z x Z the dual lattice A^ := {x G Vq p | (x,A( i)3 -)) Q C Z p } 
of A(jj) is given by A^^j). Consequently the multichain £ is a self-dual. 

Let G Z x Z. We denote by P(ij),+ : A (ij -) -> A ( j +1>j) , _ : 

A-Uj) — > Aaj + i\ and paj) '■ Aha — > A( i+1 j +1 ) the inclusions. We denote 
by : A (n+ ij) -)• A (iJ) (resp. %,,•) _ : A (i)n+i) ->■ A (ij -), resp. : 

A/ n+i)n+J --) — )• Auj\) the isomorphism given by multiplication with ttq in the 
first (resp. second, resp. first and second) component. We further denote by 
('> : A (i,j) x A (-i-») Z p the restriction of (•, -) Qp - 

We find that (£+,£_), equipped with ((■> 0(i ^ s a polarized multi- 

chain of Of ® Zp-modules of type (£), which, by abuse of notation, we also 
denote by C = £ split . 
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Denote by (-, •)(» j) : x ~> ®v x @v the restriction of the 

*-hermitian form (Sq 1 , —Sq 1 ) (•, ')'q • It is the *-sesquilinear form described 

by the matrix I n with respect to &Uj) and £.rj_j\. 

Denote by So the set of all embeddings Fq R and by E the set of 
all embedding F <^-> C. The inclusion Oi? Op induces an identification 
of kp ± /¥ p with kp /¥ p . We write ©o = Gal(fcp /F p ) and also identify 
Gal(fcp ± /F p ) with &q. Let be the Galois closure of F inside C and choose 
a prime Q' of E' over T^. Consider the decomposition £ = E + II XL and the 
maps 70 : So — )■ ©0) 7± : £± — > ©o of Lemma 3.1.3 For a G So we denote 
by the unique lift of cr to £±. Exactly as in Section [5j we define for 
each cr G So integers r a , s a with r CT + s a = nj^jand using these the element 
J G End£®M(V 8) K). Denote by Vc-% the (— i)-eigenspace of Jc- As before, 
we construct an Op ® O^-module Mo which is finite locally free over Oe', 
such that Mo <8>o„, C = Vc,-i as Of C-modules. 

7.2. The special fiber of the determinant morphism. For u £ 6o we 

write 

r a = rv and s a = s ff / . 

a'e 7o - 1 ( CT ) o-'e^ 1 ^) 
As the fibers of 70 have cardinality e, it follows that r CT + ~s a = ne. 

We fix once and for all an embedding lqi : fcg/ M- F. We consider F as an 

0^/-algebra with respect to the composition Oe> > kg/ <—> F. Also lqi 

induces an embedding i-p : k-p F and thereby an identification of the set 
of all embeddings k-p F with ©o- 
Consider the isomorphism 

(7.2.1) O f ®¥= Yl ¥[u]/(u e ) x¥[u]/{u e ) 



obtained from (7.1.1) and our choice of uniformizer -kq. 

Proposition 7.2.2. Let x G Of and let ({q a ,+, q<r ,-)) & Ylae&o ^M/C" 6 ) x 
F[u]/(u e ) be the element corresponding to x 1 under ( |7.2.1[ ). T/ien 

Xf(x|M F) = J] (T- g(T)+ (0)) ?ir (T-g CT) _(0))^ 
o-e6o 

in ¥[T}. 



Proof. Reduce Xo e ,( x \Mq) modulo Q! , using (3.1.4). □ 

Denote by E = Q(trc(x ® l|F_j); x £ F) the reflex field and define 
Q = Q' (1 Oe. The morphism dety_ t is defined over Oe- 



7.3. The local model. For the chosen PEL datum, Definition 2.3.1 amounts 
to the following. 

Definition 7.3.1. The local model M loc = M loc,split is the functor on the 
category of Oe q - algebras with M loc (R) the set of tuples {tuj\)uj\£% x % °f 
Of <8> R-submodules tn^ C Aujyr satisfying the following conditions for all 

(ij')eZxZ. 



^In Sectionjijwe have written tv,i and r CT ,2 instead of tv,+ and r CT ,-, respectively. 
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(b) The quotient ku fi ii/tuj} is a finite locally free R-module. 

(c) We have an equality 



det 



A (ij),fl/*(i,i) 



deti 



M 



of morphisms Vq f ®r 



(d) Under the pairing (•, : A (i,j),R x A (-j-i),R 
ules tuj\ and pair to zero. 

( e ) ^(i,i),+,K(*(n+i,i)) = anc ^ %j) ,-,fl(*(i,n+j)) 



i?, t/ie submod- 



Remark 7.3.2. Let i? be an Oe q - algebra and let (tu t j))uj) £ M loc (i?). For 
(i,j) G Z x Z ; f/te decomposition (7.1.1) induces a decomposition tuj\ = 

t (i,j),+ X - int0 P^O g 

A j _ /j. yls in Remark 2.3.4 



of j (resp. i). Writing ij_ 



z p R-submodules C A,; 

one sees that ti 



and t 



(id), 



C 



(Vesp. tuj\_) is independent 

t(i,j),-> the tu P le 
is determined by the pair of tuples (tj—)j). 

Recall from Section the chain £ mert and the functor j\,f loc,mert . The 
identifications (6.2.1) and ( |7.2.1 ), together with our choices of bases, give rise 
to a canonical identification of the tuple (A^^^p, P(j,^$, (*j i) f)« 

with the chain £ incrt ® Zp ¥. 

We can then state the following result. 

Proposition 7.3.3. (1) The morphism M F ° c ' spllt 



loc, inert 
F 



given on 



R-valued points by 



M 



loc, split 

F 



(A) 



M loc, inert / \ 
F W> 



is an isomorphism. 
(2) The morphism Aut(£ s P Ut ) F 
by 



Aut(£ inert ) F given on R-valued points 



Aut(£ split ) F (i?) -> Aut(£ incrt ) F (i?), 
is an isomorphism. 



Proof. Clear in view of Remark 7.3.2 and Propositions 6.2.2 7.2.2| 



□ 



Consequently all the statements about M F ° c,inert from Section|G arc also 
valid for M' oc ' split . 



7.4. The p-rank on a KR stratum. Recall from Section 2.3 the scheme 
A/Oeq associated with our choice of PEL datum, and the KR stratification 

A(¥) = ]J A x . 

xeAut(£)(F)\M loc (F) 

We have identified the occurring index set with flo-eeo P erm ?v in Corollary 



6.6.3 We can then state the following result. 
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Theorem 7.4.1. Let x = (x a ) a G ri^eSo P erm ?v- Write x a = w a u x,T with 
w a G W, A ff £l. Then the p-rank on A x is constant with value 

9o • |{1 < * < n | Vcr G 6 (%(i) = i A A CT (i) = 0)}| 
+ 9o • |{1 < * < n | Vcr G 6oK(i) = iA^i) = e)}|. 

Proof. Define elements w' a G TV and AJ, £ I as in Lemma |6.6.4 Let 
f = {t(j j)){jj) G M loc (F) and let (£j,±)j be the two associated tuples of 
Remark 7.3.2 Let (i,j) G Z x Z. We have the following equivalences. 

A(i,j),F = i m P(i-lJ),+,F + ^ Aj )+) F = impj_i i+jF + U t+ , 
= lm P(i,j~l) ,-,¥ + ^ ^J,-,F = im/3j_l,_,F + *j - • 

Assume now that t lies in the Aut(£ inert )(F)-orbit corresponding to x under 
the identifications of Corollary |6.6.3| Consider the chain of neighbors 

A(o,o) c A( 1)0 ) c • • • c A( n ,o) c A( n)1 ) c • • • c A( nj „) = ttq A( 0)0 ), 

and let 1 < i < n. By Propositions 2.4.5| and 2.4.6, the claim of the theorem 
follows once we can show the following equivalences. 

A ii+i F = impj_i )+i F + t ij+ 4^ Vcr G 60(^(2) = i A A CT (i) = 0), 

Aj _ )F = impi_i _,f + _ 4^ Vcr G 6 (^(i) = i A A' CT (i) = 0). 

These equivalences follow from Proposition |6.5.8| and Lemma |6.6.4| by the 



arguments of the proof of Theorem 3.10.1 □ 



7.5. An application to the dimension of the p-rank locus. Assume 
from now on that Fq = Q, so that F/Q is an imaginary quadratic extension 
in which p splits. We write r = rid Q and s = s;d Q , so that n = r + s. Also 
write I n = {1, . . . ,n}. 

Note that the moduli problem A is a special case of the "fake unitary 
case" considered in [7]. Concretely, the moduli problem defined in [7J §5.2] 
specializes to A for D = F. 

Denote by t : W — > N the length function defined in [5j §2.1]. 

Lemma 7.5.1. Let x G Perm r . The smooth F-variety A x is equidimensional 
of dimension £(x). 

Proof. We know from [7J, Lemma 13.1] that A x is non-empty. The rest of 



the proof is identical to the one of Lemma 3.11.1 □ 



Let us state Theorem 7.4.1 in this special case. 

Theorem 7.5.2. Let x G Perm r . Write x = wu x with w £ W, \ £ X. Then 
the p-rank on A x is constant with value \Fix(w)\, where Fix(w) = {i G I n | 
w(i) = i}. 

We want to use this result to compute the dimension of the p-rank locus 
in Aw- We do this by copying the approach of [U §8]. 

Denote by Perm^ the subset of those x G Perm r such that the p-rank 
on A x is equal to 0. Denote by W n . r the subset of those w G W satisfying 
Fix(u>) = and 

(7.5.3) \{i e I n \ w(i) < i}\ = r. 
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Lemma 7.5.4 (Cf. [6] Lemma 8.1]). The canonical projection W — > W 
induces a bijection Perm^ — > W njT -. Its inverse is given by w ^ u x ^w with 

\{w)(l) = \ I £ I n - 

II, ifw < I 



Proof. This is an easy combinatorial consequence of Theorem 7.5.2 and the 



interpretation of Perm r in terms of extended alcoves, see Section 6.6 □ 
Define for a E S n the following sets and natural numbers. 



A, 


= {(< 


j] 


E (I„) 2 1 1 < j < < a(i)}, 


a a = 


\A a 


K 


= {(• 


3, 


E (I n ) 2 | cr(i) < o-(») < i < j}, 


d a = 


\A a 




= {(i 


3, 


E (/n) 2 | o-(i) < « < j < <r(i)}. 


K = 


\B a 


B a 


= {(< 


3. 


E (I„) 2 | i < a(i) < a{j) < j}, 


K = 


\B a 


N a 


= «<j 


+ a a + b a + b/j . 







Note that N a = N a ~i in view of the obvious identities a a = a a -i and 
b a = b a -i. 

Proposition 7.5.5. Let u x w E Perm^ , w E W, A E X. Then £(u x w) = 
N w . 

Proof. Denote by e, the i-th standard basis vector of Z n . The positive roots 
P > of GL n are given by j3ij — — ej, 1 < i < j < n. Denote by (-, •) the 
standard symmetric pairing on Z n , determined by (ej, ej) = Sy. By (8.1)] 
the following Iwahori-Matsumoto formula holds. 

(7.5.6) £(u x w) = KAA)|+ ^ |(/3,A) + 1|. 

I3>0 (3>0 
w -1 /8>0 «)- 1 /3<0 



iV nir := min((r — l)(n — r), r(n — r — 1)) 



Using Lemma 7.5.4 the equality £{u x w) = N w -i readily follows. □ 
Define 

(r — l)(n — r), if r < n/2, 
r(n — r — 1), if r > n/2. 

Proposition 7.5.7. Lei a E W n ,r- TTien A^ CT < N n>r . 

Proof. Consider the set M = {(n, r, io) E N 3 | 1 < r < n — 1, 2 < io < n} 
and equip it with the lexicographical ordering <, which is a well-ordering 
on M. For (n, r, io) E M we define W nt r t i = {a E W„^ | min{2 < i < n | 
cr(i) < i} = io}- Denote by V(n,r,io) the following statement. 

Va E W^io : N a < N n>r . 

We will prove it by induction on (n, r, io). 

Let (n, r, io) E M, cr E W( nrio \ and assume that V(n',r',i' ) is true for 
all (n',r',i ) E M with (rt', r',i ) < (n, r, i ). Set cr' = cr o (i - l,i ). We 
distinguish the following four cases. 

Case 1: cr(io) < io — 1 and a(io — 1) > io- 

Case 2: cr(io) = io — 1 and a(io — 1) > io- 
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Case 3: cr(io) < io — 1 and a(io — 1) = io- 
Case 4: a(io) = io — 1 and a(io — 1) = io- 

We use the example of Case 2 to illustrate how to proceed. So assume 
that a(io) = io — 1 and <r(io — 1) > io- 
We read off the following identities. 

a<r = a a ', 

a a = a a > + \{j G I n | a(j) < i - 1 < i < j}\, 

b a = K> + \{j e I n | i - 1 < io < j < 

b(j = b a > + \{i G I n | i < a(i) < i - 1 < i }|. 

Identifying {1, . . . , io — 1, . . . , n} with {1, . . . , n — 1}, we consider the re- 
striction cr'l^ n y as an element of W n -i jr -ij for some jo- By induc- 
tion hypothesis we know that N a i = N a n < N n -i r -\. In view of 

l{l,...,i -X,...,n} ' 

N n ,r — N n —i r —i > n — r — 1 it therefore suffices to show the following two 
inequalities. 

io - 2 > \{j G I n | <r(j) < i - 1< i < j}| + |{i € I n \ i < a(i) < i - 1}|, 
n - r - (i - 1) > \{j e I n | io < j < <r(j)}\- 

For the first inequality, it suffices to note that a maps both sets in question 
into Ii -2- On the other hand, by the definition of io we have h -\ C {i G 
I n \i < cr(i)}, so that (7.5.3) implies the second inequality. □ 

Proposition 7.5.8. We have 

max N a = N n , r - 

Proof. It suffices to show that there is a a G W n , r satisfying N a = N n>r . As 
W n>r — > W n , n -r, cr h-> o" -1 is a bijection and as N a = N a -i, we may assume 
that r < n/2. One easily checks that 

a = (1, 2)(3, 4) • • • (2(r - 1) - 1, 2(r - l))(2r - 1, 2r, 2r + 1, . . . , n) G W n , T 

satisfies N a = (r — l)(n — r) = iV njr .. □ 

Denote by ^l^ ^ C ^4(F) the subset where the p-rank of the underlying 
abelian variety is equal to 0. It is a closed subset and we equip it with the 
reduced scheme structure. From the discussion above we obtain the following 
result. 

Theorem 7.5.9. dim^l 1 - ^ = min((r — l)(n — r), r(n — r — 1)) . 
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